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Abstract. For smooth hyperbolic dynamical systems and smooth weights, we 
relate Ruelle transfer operators with dynamical Fredholm determinants and 
dynamical zeta functions: First, we establish bounds for the essential spee- 
ch ■ tral radii of the transfer operator on new spaces of anisotropic distributions, 

improving our previous results [?]• Then we give a new proof of Kitaev's 
1171 lower bound for the radius of convergence of the dynamical Fredholm 
determinant. In addition we show that the zeroes of the determinant in the 
■ corresponding disc are in bijection with the eigenvalues of the transfer operator 

^ ' on our spaces of anisotropic distributions, closing a question which remained 

' open for a decade. 

o 

\ 1.1. Historical perspective. The spectral properties of transfer operators 

r*^ ' and their relations to analytic properties of dynamical Fredholm determinants and 

\ dynamical zeta functions are fascinating subjects in study of smooth dynamical 

' systems. The basic idea about the relation is rather simple: The dynamical Fred- 

\ holm determinant of a transfer operator C associated to a dynamical system T and 

^ ■ a weight function g is formally defined by 

X 



1. Introduction 



dc{z) - det(M - zC) exp I - ^ — ^ ^'^"'^^''^ 



C3 ■ ' ^ ' ' ' \ ^ m ^ |det(Id-i:'T"(x))| 

Naturally, we would like that the inverse of each eigenvalue of the transfer operator 
C appears as a zero of the dynamical Fredholm determinant. To make mathemati- 
cally rigorous statements, we first have to show that the transfer operator has nice 
spectral properties (similar to those of compact operators) on a suitable Banach 
space. Finding the right Banach space is thus one of the hurdles in this subject. 
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Then, we have to give an interpretation of the sums over periodic points as (ap- 
proximate) traces of transfer operators, recaUing the formal relation 



For analytic hyperbolic diffeomorphisms and weights, it has been known for a 
long time that dc{z) is an entire function when the dynamical foliations are analytic: 
This is the content of the fundamental paper of Ruelle [23. , who showed that the 
transfer operators are nuclear on a suitable space of functions using Grothendieck's 
theory of nuclear operators. More recently, Rugh '25' and Fried [14' studied dc{z) 
in the hyperbolic analytic framework, but without any assumption on the foliations, 
giving a spectral interpretation of its zeroes (however, not quite as the eigenval- 
ues of a natural transfer operator C). In the case of finite differentiability r, the 
connection between transfer operators and dynamical determinants of expanding 
endomorphisms has been well understood by Ruelle (see [24]). 

In a ground-breaking article [17[ circulated as a preprint since 1995, Kitaev 
considered hyperbolic diffeomorphisms of finite differentiability C", and obtained a 
remarkable formula pr infg<o<p,p-g<r-i /3^'''(7', 5) (see Section [TT^ for a defini- 
tion of pP''^{T,g)) as a lower bound for the radius of a disc in which dc{z) admits 
a holomorphic extension. But Kitaev did not construct a Banach space and his 
approach does not give spectral results. Interpreting the zeroes of dc{z) in the 
disc furnished by Kitaev as inverse eigenvalues of a transfer operator remained a 
challenging problem for over a decade. 

The main contribution of the present paper is to close this problem (Theo- 
rems [O] and [13]) . Along the way, we give a new proof of Kitaev's result. In addi- 
tion, we give a new variational-like interpretation of Kitaev's formula pP''^{T^g) as 
a kind of generalised topological pressure QP '^{T, g) fLemma ll.4p . 

Finding appropriate Banach spaces 

The first reason why this problem remained open for so long is that there were 
until recently no good Banach spaces adapted to the transfer operators of hyperbolic 
dynamical systems in finite differentiability: For a long time, statistical properties of 
hyperbolic diffeomorphisms were investigated using symbolic dynamics via Markov 
partitions. Since the correspondence is not smoother than Holder, the information 
thus obtained on the spectrum of transfer operator was severely limited, and this 
made it difficult to go beyond the results on dynamical zeta functions by Parry 
and PoUicott (see [21] ). (See Section 2 for a discussion about dynamical zeta 
functions ^T^giz).) Recently, in a pioneering work 9 , Blank, Keller and Liverani 
introduced scales of Banach spaces of distributions on the manifold adapted to 
hyperbolic diffeomorphisms and proved that the transfer operators acting on those 
Banach spaces have a spectral gap. However, there were technical restrictions in 
the methods in [9], which did not allow them to go beyond Lipschitz smoothness. 
These restrictions were removed by Gouezel and Liverani [15] and by the authors 
[7] independently, but using different kind of Banach spaces. The intuitive idea 
is the same for both kind of Banach spaces: They consist of distributions on the 
manifold, which are as smooth as functions for some p > in directions close 
to the unstable direction, and which are as rough as distributions of order —q for 
some g < in directions close to the stable direction. However the real construction 
of the Banach spaces in [15] and [7] are quite different. We refer to the original 
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papers for details. (The reader-friendly survey ^ will be helpful to get ideas in the 
construction in 7 .) 

In our first main result (Theorem ll.ip , we introduce yet another scale of Banach 
spaces, C'''^, which is a kind of hybrid of those in JTj and ^ISj . and gives a better 
upper bound on the essential spectral radius. This upper bound coincides with 
Kitaev's formula pP^'(T, g) (Lemma II. 4|) . In view of the results [16] of Gundlach 
and Latushkin for expanding maps, we believe that our bound is optimal. 

Introducing appropriate traces 

The second difficulty to solve this problem in the case of hyperbolic C diffeo- 
morphisms is to find an appropriate definition for the trace of transfer operators 
that are not even compact. Liver ani |19| found a simple argument to relate eigen- 
values of C with zeroes of the dynamical Fredholm determinant dciz), using the 
Banach spaces in [15j . More recently, Liverani and Tsujii [20j provided an abstract 
argument that is adaptable to both of the Banach spaces in |15j and [7] and that 
improves the result in [19] . Still, by technical reasons, the methods in |19| and [20] 
give the relation only on a strictly smaller disk (by the factor of one half, at least) 
than that given in Kitaev's [17) formula. Our second main result (Theorem II. 5[) 
improves this point. 

In this paper, we use the structure of our Banach spaces to define the trace. 
The basic idea in the construction of our Banach spaces is to view functions u on 
the manifold as superpositions of countably many parts u-y, 7 £ T, each of which 
is compactly supported in Fourier space (in charts). Accordingly we regard the 
transfer operator as a countable matrix of operators Cj-yi . Each operator C-yj' turns 
out to have a smooth kernel. Thus we may define the trace of C-y-y as the integration 
of its kernel along the diagonal, and then the trace of the transfer operator C as the 
sum of the traces of the Cj.y. We found that hyperbolicity of the diffeomorphism 
ensures that this trace coincides with the expected sum over fixed points. Then, 
using the abstract notion of approximation numbers [22] . we estimate the traces 
thus defined and get our second main result (Theorem II. 5p . This implement the 
idea mentioned in the beginning for the case of C" hyperbolic diffeomorphisms. 

1.2. Main results. In the following, X denotes a d-dimensional C°° Riemann 
manifold and T : X ^ X is a diffeomorphism of class C for some r > 1. If r is 
not an integer, this means that the derivatives of T of order [r] satisfy a Holder 
condition of order r — [r] . Our standing assumption is that there exists a hyperbolic 
basic set A C X for T, that is, a compact T-invariant subset that is hyperbolic, 
isolated and transitive. By definition there exist a compact isolating neighbourhood 
V such that A — r\mei.T'"^ i^) and an invariant decomposition T/^X = (B of 
the tangent bundle over A, such that \\DT"'\es\\ < CA™ and \\DT-"^\e^\\ < CA™, 
for all m > and x € A, with some constants C > and < A < 1. By transitivity, 
the dimensions of E^{x) and E^{x) are constant, which are denoted by du and dg 
respectively. We will suppose that neither ds nor d„ is zero. 

For s > 0, let C'^{V) be the set of complex- valued functions on X with 
support contained in the interior of V . The Ruelle transfer operator with weight 
g e C"-i(y) is defined by 

C = Cr.g : C^-\V) ^ C^-\V), C^{x) = g{x) ■ ^ o T{x). 

Our first theorem improves the results of ^ and |,15j on the spectrum of C. For 
a T-invariant Borel probability measure on A, we write h^{T) for the metric 
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entropy of {ji^T), and X/^(^) G M U {—00} for the largest Lyapunov exponent of 
a linear cocycle A over T|a, with (log||yl||)+ G L^{d^i). Let A^(A,T) denote the 
set of T-invariant ergodic Borel probability measures on A. Then the theorem is 
stated as follows. 

Theorem 1.1. For each real numbers q < < p so that p — q < r — 1, there 
exists a Banach space CP'''{T,V) of distributions on V, containing C^{V) for any 
s > p, and contained in the dual space of C^{V) for any s > with the following 
property: 

For any g G C^^^{V), the Ruelle operator Ct^q extends to a bounded operator 
on C^''^{T, V) and the essential spectral radius of that extension is not larger than 



mr,g) = exp sup U,,(T) + Xm 
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/i6M(A,T) \det(£)T|£;u 

+ m&^{pX^.{DT\E^)^q\x^.{DT-^\E^)]Y 

Note that, in the setting of expanding endomorphisms, Gundlach and La- 
tushkin [111 §8], [16] showed that the essential spectral radius of the transfer oper- 
ator acting on C"'~^(X) is given exactly by a variational expression analogous to 
QP'?(r,g). 

Remark 1.2. By upper-semi-continuity of /i /i^ , /i ^ x^J.{^)^ the supremum 
in the expression for QP'''(T,g) is a maximum. Also we have ^^(g/ det(£'T|£;u)) = 
/ log \g\ dfi — J log I det{DT\E^)\ dfj,. This artificial expression as a Lyapunov ex- 
ponent will make sense when we consider Ruelle operators on sections of vector 
bundles in the next section. 

Remark 1.3. Note that we have 

Q^'^T^g) < A'""^P^-?> • Q°'°{T,g) < Q°'°(r,g) . 

We shall see in Remark 11.61 that, if g > on A, the spectral radius of CT,g on 
CP.9(T, V) coincides with Q°'"{T, g). 

To compare the results in this paper with those in Kitaev's article |17| . we next 
give an alternative expression for QP''^{T,g). For g G C^{V) and m > 0, we write 

m— 1 

g^^Hx)= l[g{T'{x)). 

We define local hyperbolicity exponents for a; G A and m G Z+ bj0 

\\DT^{v)\ 



A,(T") = sup 

fl.l) 



DT^'iv) G £;"(T"(x)) \ {0} ^ < CX 



i^^{T"') = inf ( V G E'^ix) \ {0}\ > 

I M J 

For real numbers q and p, an integer m > 1 and a; G A, we set 
A(p-«-™)(x) = max{(A.(r™)f, (^^.(r"))'} • 

We may extend E'^{x) and E^{x) to continuous bundles on V (which are not 
necessarily invariant), so that the inequalities in (|l.ip hold for all x G n^!rQ^T~'^(y) 



^The definition of \x{T^") may look a bit strange. We need this formulation for the extension 
of E''(x) just below. 
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and for all m > 0, with some constant C. Taking such an extensiorH, we extend the 
definition of A^(T™), i^a;(T"), and A(P'«'")(a;) to nllI'QT-''{V). Letting dx denote 
normalised Lebesgue measure on X, define for integers m > 1 and p, q eM. 



(1.2) pP''i{T,g,m)= |g('")(a;)| ■ A(P'«'™)(a;) . 

Jx 

Kitaev pTTj provecJl that the limit 

pP-«(T,5)= lim (/'nr,5,m))i/™ 

m — ^oo 

exists for all g < < p in M and g E C^{V) with S > 0. In Section [31 we show: 

Lemma 1.4. For any g e C^{V) with 6 > 0, we have QP^'^{T,g) = ff^'^{T,g) 
for all real numbers q < < p. 

In [7] we proved a result similar to Theorem 1 1.1) with C'*(T, 1/) replaced by 
other spaces of anisotropic distributions C^'''^{T,V), respectively W^'"^' {T,V) for 
1 < t < oo, and with the bound QP''^{T,g) replaced by RP''^'°°{T, g), respectively 
RP^i^t{T,g), where 

/ \ 1/™ 

RPi-*{T,g) = lim sup | det DT""]-^/* (x) ■ \g^"''> {x)\\^p^'^^"''> (x) 

Note that if I detL>r| < 1 then Mte[i,oo] RP''''\T,g) = RP''i^°°{T, g). Since 

exp(^X,.{9) +'^s.x{px^{DT\E^),\q\x^{DT-^\E^)} ^ 

/ \ 1/™ 

< lim sup|.g(™)(a;)|A('''«''")(x) 

the variational principle tells that we have QP'''{T,g) < RP '^ °°{T, g) in general and 
the equality holds only if the supremum in the definition of QP''^(T, g) is attained by 
the SRB measure for T. Therefore Theorem 11.11 can be viewed as an improvement 
of our previous result [7]- In Appendix IB] we prove that, in general, 

(1.3) /'^(r,g)< inf i?f^''*(T,5), 

tG[l,oo] 

where the inequality can be strict. 

Another improvement on [7] is that we now have the same bounds for the 
essential spectral radii of the pull-back operator and the Perron-Frobenius operator, 
which are dual of each other: Takc0 h e C°^{V) so that /i = 1 on a neighbourhood 
of A, and consider the pull-back operator ip t—^ h ■ ip o T on BP''^{T,V), and the 
Perron-Frobenius operator {h ■ Lp) o T-^ ■ \ det{DT-^)\ on B-1'-p{T-^ ,V). 

Exchanging the roles of i?^ and E^, the bounds in Theorem 11.11 for the essential 
spectral radii of these operators coincide: 

QP^''{T,g) = g-''-f(r-i,5. Idct(OT-i)l) . 



The choice of extensions is not essential. 
■^Kitaev used the notation pP'~'^(C) for our pP''^ (T, g). 

■^We need to multiply by h to localize functions to V. If T is Anosov, we may forget about h. 
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We next turn to dynamical Fredholm determinants. The dynamical Fredholm 
determinant dc{z) corresponding to the Ruelle transfer operator C = C-T,g is 

-E- ^ |det(Id-I)T-(x) )| 

The power series in z which is exponentiated converges only if \z\ is sufficiently 
small. (See Remark 11.61 ) Our main result is about the analytic continuation of 
dc{z): 

Theorem 1.5. Let g e C-^iV). 

(1) The function dc{z) extends holomorphically to the disc of radius {Qr-i{T, g))^^ 
with 

Qr-i{T,g)= inf Q'^''^{T,g). 

9<0<p, p — q<r—l 

(2) For any real numbers q < < p so that p — q < r ~ 1, and each z with 
\z\ < {Q^''^{T, g))~^ , we have dc{z) — if and only ifl/z is an eigenvalue of C on 
CP''^(T,V) , and the order of the zero coincides with the algebraic multiplicity of the 
eigenvalue. 

Remark 1.6. The sum over m in the right hand side of (|1.4p converges when 

\z\ < exp(^~Ptop{T\A,logi\g\/\dct{DT\E^)\))^ ^ iQ°'°{T, g))-\ 

so that dc{z) is a nowhere vanishing holomorphic function in this disc. To see this, 
note that there is C > 1 so that for all m and all a; e A with T™{x) — x 

1 det(Id- JT^Cx))! 
- |det(i^r'"|£;.)(a;)| " ' 
then use the Cauchy criterion for the convergence of a power series and the ex- 
pression of topological pressure as an asymptotic weighted sum over periodic orbits 
(see, e.g., |21[ Prop. 5.1]). If g > on A, then it follows from Pringsheim's the- 
orem on power series with positive coefficients ^18> §17] that dc{z) has a zero at 
(Q"'"(T,g))-i. 

This paper is organized as follows. In Section [51 we discuss about transfer 
operators acting on sections of vector bundles, with applications to dynamical zeta 
functions. In Section [31 we present a key alternative expression for the bound 
QP''^{T,g) (useful also to prove both main theorems), and we prove Lemma [Ol 

In Section [H we consider the transfer operator L on R'^ for a C diffeomor- 
phism T and a C"""^ weight G. We first introduce the Banach space C^'P''^{K) of 
anisotropic distributions on a compact subset i^T C K'*, slightly modifying the defi- 
nitions in [7] : the L°° norm in the definition of anisotropic spaces in [^ is replaced 
by a mixed norm, which involves both the supremum norm and the L^-norm along 
manifolds close to unstable manifolds. To study the action of the transfer operator 
L on this Banach space, we work with an auxiliary operator M, which is an infinite 
matrix of operators describing transitions induced by L between frequency bands in 
Fourier space. We observe that the operator M is naturally decomposed as M^ + Mc 
with Mb having small spectral radius and Mc a compact operator. In Lemma |4.17[ 
we give a simple estimate on the operator norm of Mb. In Subsection 14.31 we study 
the approximation numbers of M^ and show, in particular, that Ale is compact. 
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The use of approximation numbers to study dynamical transfer operators seems to 
be new. 

In Section O we introduce the anisotropic Banach spaces CP''^{T, V), and prove 
Theorem ll.il Taking a system of local charts on V adapted to hyperbolic structure 
of T, we consider the system /C of transfer operators that C induces on the local 
charts. Then we associate an auxiliary operatoillA4 to /C, in the same manner 
as we associate M to L in Section H) The spectral data of K. and A4 turn out 
to be (almost) identical with that of C. We will decompose Ai™ for m > 1 as 
(7W")fc + {M"^)c, where (A^™)c is compact and {M"^)b has norm smaller than 
C{QP 'J{T,g) + e)™, proving TheoremO 

In Section [6l we introduce a formal trace tr^{V), called the flat trace, and a 
formal determinant det^(Id — zV) = exp — J2m>i iirtr^('P'"). The flat trace is a 
key tool inspired from [5l [6]. (The terminology was borrowed from Atiyah-Bott 
[1], but we do not relate our flat trace to theirs.) Our flat trace coincides, on the 
one hand, with the usual trace for finite rank operators and, on the other hand, 
with the dynamical trace for each Ai"'". 

Also, the flat trace tr^((A^'")fc) vanishes for all large enough m. 

In Section [71 we give the proof of Theore m 1 1.51 The basic idea of the proof is 
then to exploit the formal determinant identitjo 

(1.5) det^(Id - zM) = det^(Id - zMc{ld - zMby^) ■ det\ld - zMb) ■ 

If r > d+l+p — q each operator {Ai™)c turns out to be an operator with summable 
approximation numbers, and our proof in this case is fairly simple, although we 
cannot apply (jl.Sp directly, since we only know that tr^((A^™)b) = and that 
the spectral radius of {A4"^)b is smaller than {QP''^{T,g) + 2e)™ for large ni. If 
r < d + 1 + p — q, we need more estimates since only some iterate of (A^™)c has 
summable approximation numbers. Still the proof is straightforward. Q 

In Appendix \^ we discuss about eigenvalues and eigenvectors of the transfer 
operator C on different Banach spaces. 

2. Operators on vector bundles and dynamical zeta functions 

We may generalize the statements and proofs of the main results to similar 
operators acting on spaces of sections of vector bundles. Since Ruelle zeta function 
is given as a product of the dynamical Fredholm determinants of such operators 
[131 123) . we can derive statements for Ruelle zeta functins from our main theorems. 
See also |21j for a presentation of classical results about dynamical zeta functions. 

For r > 1, T, and V as in Section 1, let tt^ : B ^ V he a. finite dimensional 
complex vector bundle, and let T : i? — > i? be a C"""^ vector bundle endomorphism 
such that ttb oT = T^^ ot^b- Denote the natural action of T on continuous sections 
of S by £ = £t, that is, Cu{x) = T(u(T(x))). Then we can define QP'«(T,T) in 



^It is possible to work directly with C, decomposing it into a compact term Cc and a bounded 
term Ct,, on C^''^{T, V), in the spirit of [5]. Then the flat trace of (£'");, is not zero, but it decays 
exponentially, arbitrarily fast |4| . 

^The operator X'(z) = 2:A^c(Id — zMi,)~^ can be viewed as a kneading operator, [6], [3]. 

'^See [3] for a "regularised determinant" alternative to the argument in Section 7. 
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parallel with the definition of QP '^{T,g) in Section 1, replacing ^^(g/ det(£'r|iJ")) 
by XM(T/det(Dr|£'")). Putting, for to > 1, 

|T(™)|(x) = ||T™:S,^i?^_(,)|l, 

we can define p^'''{T, T, to) by using the same formal expression as for ff''^{T, g, m). 
The next statement is just a formal extension of Theorem 11.11 and Lemma 1 1.41 

Theorem 2.1. Let q < < p be so that p ^ q < r — 1. There exists a Banach 
space C^''^{T,B) of distributional sections of B, containing sections for any 
s > p, so that the operator Cf extends to a bounded operator on CP'''{T, B), and its 
essential spectral radius on this space is not larger than QP'''{T,T) = pP''^{T,T). 

Note that if B is the k-th exterior power of the cotangent bundle of X then 
CP-i[T, B) is a space of currents on X. 

The dynamical Fredholm determinant oi C = Cf as above is defined by 

_f;z^ trT- 
cl£l^j-exp 2^ ^ 2^ |det(Id-I?r™(a;))| ■ 

A formal extension of Theorem 11.51 gives : 

Theorem 2.2. For any q < < p so that p — q < r — 1, the function dc{z) 
extends holomorphically to the disc of radius ((5^''(T, T))^^, and its zeroes in this 
disc are exactly the inverses of the eigenvalues of on C^'^'lT, B), the order of the 
zero coinciding with the multiplicity of the eigenvalue. 

Let ttl : L — > A be the orientation line bundle for the bundle tte^ ■ E'^ A, 
that is, the fiber of L at a; S S is isomorphic to the real line whose unit vectors cor- 
responding to an orientation on E'"'{x). By shrinking the isolating neighbourhood 
V, we may extend it to a continuous line bundle tt^ : L — > V^. Let g G C'^~^{V). 
For fc = 0, 1, • ■ • , d, let ir : Bk = (a'=T*X) ^ L ^ V and let : Bk Bk be the 
vector bundle endomorphism defined by Tk{w) — (g o tt) • T*{w). Let Ck be the 
natural action of on the sections of Bk- Then the Ruelle zeta function 

m=l T"«(x)=K 

can be written as 

CT,(.)=nrf..(.)(-^'^"^'"""v 

Thus we obtain as a corollary of Theorem 12.21 

Corollary 2.3. The Ruelle zeta function CT,g{z) extends as a meromorphic 
function to the disk of radius 

min sup {g^'''?(r, Tfc)-i \ q<Q<p, p-q<r-l]. 

0<k<d 

3. Alternative expressions for the bound QP '^{T,g) 

In this section, we introduce two more expressions, Qr''^{T,g) and p'i''^{T,g), in 
addition to Q^''^{T,g) and pP''^{T,g), inspired by [17) . And we show that these four 
expressions are all equivalent, proving Lemma 11.41 especially. Along the way, we 
express log QP'*(T, 5) as a double limit of topological pressures (Lemma l3.5p . Note 
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that the expression Q^''^{T, g) wiU play a central role in the proofs of Theorems ll.il 
and 11.51 in the following sections. 

In this section, r > 1, T and A C are as in Section 1, but we only assume 
g € C^{V) for some S > (and sometimes only that g G C^{X)), even if r is large. 

Remark 3.1. Unlike the standard argument [2 8j on topological pressure, we 
consider the case where the function g may vanish at some points on A. If we 
assumed that g vanishes nowhere on A, the argument in this section should be 
simpler and partly follow form the standard argument. 

3.1. The expression Q^'''{T,g) and topological pressure. Recall that, in 
Section [U we extended the decomposition T^X — E''{x) ® E^{x) on A to 1^ and 
defined KiT"") and v^{T'^) for x G n^^(,^"'=(y). Using this extension, we also 
define 

(3.1) I dct{DT'^\E^)\{x) for x e n^^gT-^X^) , 

as the expansion factor of the linear mapping DT™ : i?"(x) _DT™(_E"(a;)), with 
respect to the volume induced by the Riemannian metric on each (i„-dimensional 
linear subspace. Note that, for each g G C"(V"), the sequences of functions g^™^ 
and I det(I?T'"|£;«)| are multiplicative, while A'^'^'™^ is submultiplicative in m for 
aU real numbers q < <d < p. In particular, jg^")] • A*?'^'?^'") • \ Aet{DT'^\E^)\^'^ is 
submultiplicative in m for such p and q. 

We say that W is a cover of V if it is a finite cover W — {Wi\i(zx of V by 
open subsets of X and if, in addition, the union Ui^jWi is contained in a compact 
isolating neighbourhood V' of A. For such a cover W and integers n < m, put 

and set W" = W^" for m > 1. Then W™ is a cover of ~ f^T:^oT-''{V). We 
say that a cover W of is generating if the diameter of >V™„ tends to zero as 
TO ^ oo. (Generating covers exist because ri™^_^T~^V is contained in a small 
neighbourhood of A for large to.) For real numbers p and q, an integer m > 1, a 
generating cover W otV, and g G C°(X), we define 

(3.2) Q:''^(T,g,>V,TO) = min V sup , 'f , ' , 

w c/ |det(i^r™|£.)iy 

where the minimum minw' is taken over subcovers W C W™ of V^. By sub- 
multiplicativity with respect to to, the following limits exist if 9 < < p: 

Qrm5,W)= lim (QP^«(r,5,W,TO))^/™ . 

m — >QQ 

The following lemma may not be new. But, since we did not find it in the 
literature, we provide a proof. 

Lemma 3.2. For any generating cover W ofV and g G C'^{X) with infx \g\ > 0, 
we have log q2^°(T, g, W) = Ptop{T\A, log(|g|/| det(DT|£.)|)) . 

Proof. It is enough to show 

(3.3) \ogQ','°{T,g,W) < Ptop{T\A,\og{\g\/\det{DT\E^)\)) , 

since the inequality in the opposite direction is clear. Let W = {Wijigj. Take 
another cover U — {Ui}i^x of V, so that Ui d Wi for i G X. Consider small e > 
so that, for each i el, the e-neighbourhood of Ui is contained in Wi. 
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Let W, :^ r\kjT-^m.) and f/r au^T-^U,,) for i= {lu)^-,' e Z" 
For each m > 1, let Q\{T, g,U,m) be the minimum of 

2^ sup 



.gj',j/rnA |detpT™|i=;.)l 

over subsets T' C X™ such that {[/?("! A | i'g I'} is a cover of A. Let X' — I'{m) be 
a subset of that attains this minimum. 

Since V is an isolating neighbourhood for the hyperbolic basic set A, we can 
take large N so that, if T^{x) GFforO<fc<n + 2N ^ there exists a point y G A 
such that d(T^+^{x), T^{y)) < e for all < fc < n. This implies that 

{Wt I (*fc)rJo''^"' e r"+2^ and {iu+n)1:=^ e J\m)} C W"+2^ 
is a cover of Therefore we have, for all to > 0, 

(771 + 2^)1 \ 



min ( inf — — rr I < C ■ Qa(T, qM.m) , 



where the minimum is taken over subcovers W' C W™+2^ of y™+2^^^ a^d hence 
JSI^ 1 log nhn ( J2 M.. M I ^ f^U' log ■ 



m-ooTO "w'cw" c/ IdetpT^liju)!^ - '"'^ V IdetpTlB.)! 

Since g is continuous and positive and since W is a generating cover, the left hand 
side coincides with logQ'i'^{T, g,W). □ 

We next express log (5*''(T, t;, W) as a limit of topological pressures under the 
condition infx \g\ > 0: 

Lemma 3.3. If W is a generating cover of V and if q < < p, then for each 
g G C*'(A') such that infx \g\ > 0, we have 

1 / |o(™)| . A(P'«'™) 

(3.4) logQP^«(r,5,>V) = hm -P.oJ T™|A,log ' 



m^ooTO '"^V |det(-Dr™|£.)| 

Proof. The topological pressures in the claim are well-defined because for 
each TO the function log km, with 

hm := |.g(")| • A(f^^^") • I det(OT"U.)|-i , 



is continuous on A. The limit in (j3.4|) exists by sub-multiplicativity of m t— > 
For each e > 0, there exists m > 1 so that 

(Q£-«(T, g, W) + e)™ > Qp^'^{T, g, W, to) - g°'"(T™, |g(™) | •9-") , W™, 1) . 

By Lemma 1321 the right-hand side is not smaller than exp(Ptop(r™|A, log /im))- 
Hence 

Ql'%T,g,W)> lim exp((l/TO)Ftop(T'"|A,log/i™))-e. 

m— >oo 

Since e > is arbitrary, this give the inequahty in one direction. 
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We next show the inequahty in the opposite direction. By sub-multiphcativity 
and Lemma l3.2| we have, for any integer m > 0, that 

log Ql'^{T,g,W)^ hm ^ log QS'°(r™M5(™'=) | A(P'«'™'=\ >V'"^ 1) 
k^oc mk 

= -logQ°'°(T"M5(™)|A(P-«-™),W™) = -Ptop(T" Ia, log /i™). 
m m 

This gives the inequality in the opposite direction. □ 
To get rid of the assumption iiifx \g\ > 0, we shall use the following: 

Lemma 3.4. Let W be a generating cover ofV, let g G C'^{X), and let q < < 
p. If gn is a sequence of functions in C^(X) so that mix 9n > with gn > <?n+i > 
\g\ for all n, and lim„^oo hn - |5lllL~(y) = 0, then 

hm Qr(r,g„,W) = Qr(r,g,W). 

n — yoo 

By Lemmas 13.31 and the exponent Q^''^{T,g,W) for any g G C°(X) does 
not depend on the generating cover W. So it will be denoted by Q^''^{T,g). 

Proof. We have only to show lim„^oo (9*''^(T, 5„, W) < QS'''(r, g, W). For 
any e > 0, we take large m such that Ql^'^iT, g,W,m) < {Ql''' {T , g ,W) + e)". 
Then take such that OS''(T, 5„, W, m) < {Ql''^{T, g, W) + 2e)™ for n > uq. By 
sub-multiplicativity, we get Q^*''^{T, 5„, W) < Ql '^iT, g, W) + 2e for n > riQ. □ 



3.2. A variational principle. Lemmas 13.31 and 13.41 allow us to prove: 

Lemma 3.5. QP-'^{T,g) = Q^'\T,g) for q < < p and g e C"{X). In particu- 
lar, for every sequence gn as in Lemma \3.4\ we have 

\ogQP'^{T,g) = hm lim 1p,op(T™|a, log(5i™)A(^'''?''")| detpT'^l^^.)!"')) ■ 

n — >oo m — ^oc jjl 

Proof. We first show the claim when inf^: j^l > 0. For simplicity, we put 

and 

f 1^1 

P{lj) = h^j,{T) + j -j-^^^^^^:^— -yd/i + max{xp(Ai),X</(Ai)}, 
so that logQP'''(T, 5) — sup^^g^^^.T) -P(m)- Next we put 

PM^^h^{T)+ j log(|5(™)| .A(P'«'™) • |detpr™|B.)r') d^i . 
By the variational principle [28 , Lemma 13.31 implies 



logQP'«(r,g)= lim sup -PM- 
™^°°A'eAi(A,T) m 



Note that, for any invariant probability measure /i, Oseledec's theorem |28) gives 
(3.5) lim — log A^^''''™''(a;) = max{xp(^), for ^-a.e. a;. 



m— >oo m 
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Wc first show QP 'i{T,g) < Ql''^{T,g). There exists a measure fio e Al(A,r) 
such that P{pq) = log(QP'«(r,g)). (See RemarkHH) By ([331), we obtain 

logO:'^(T,5) > hm -PM = PM = logQf'«(r,g) . 

m— »oo m 

We next show QP''^{T,g) > QP''^{T,g). For each m, we take e >1(A,T) such 
that Pm{l^m) = sup^g7n(A,T) Pmilj) ■ Then we take a subsequence ra{i) oo such 
that /i„i(i) converges weakly to an invariant probabihty measure /ioo on A. By 
decomposing /ioo into ergodic components we see that logQ^''^ {T, g) > P(/ioo)- 
Thus, the claim QP'i{T,g) > QP'''{T,g) follows if we show 

(3.6) P{^^oc) > hm -^Pm{i){^^m(^)) ■ 

By the upper semi-continuity of entropy, we have h^^^ (T) > lim^^oo '^^'^(i) {T)- By 
sub-multiplicativity of A^*''''™^ and l|3.5p . we have 

limsup / T- d^im(i) < inf / d/ioo < max{xp(/ioo), Xq(Moo)}- 

i^cx) 7 m(i) m>ij m 



Therefore we get the inequality (j3.6p . 

Finally we consider the case infx \g\ = 0. Take a sequence gn as in Lemma [331 
In view of Lemma 13.41 and the argument above, it remains to show QP''^{T,g) = 
lim„^oo Q^''^{T,gn) for (7 < < p. Note that the sequence QP''^{T,gn) is decreasing 
and we have QP'''{T, g) < lim„_>oo Q^ '^iT, g„) obviously. We show the inequality in 
the opposite direction. We write P{g,fi) for P{^)- For each n, take /i„ S M.{K,T) 
such that PigmfJ-n) = Q^'''{T^ 9n) ^^nd then take a subsequence n{i) 00 so that 
/i„(i) converges weakly to some invariant probability measure /ioo on A. Then, by 
upper-semi-continuity of the entropy and of the largest Lyapunov exponent as a 
function of /i, we obtain 

lim QP'«(T,5„) < liminfP(g„,/i„) < P(5,/ioo) < Q^^'?(T,(?). 

n — *oo n—*oo 

□ 

We may now complete the first step towards the proof of Lemma IL4I 

Lemma 3.6. pP'«(T,g) < Ql'''{T,g) for any q < < p and g e C°(F). 

Proof. Take a generating cover W = {Wi} of V. Then, by a standard ar- 
gument on hyperbolicity, we can showQ that the Riemann volume of U € W™ is 
bounded by C/| det(il'r"'|£;")(a;)| for any x G U, where C is a constant that does 
not depend on U, x or m. Then we have, for any subcover W' C W™ of V"\ 

^"(-.-.) ^ /„ ^ C - - ^S^Sf ■ 

This imphes pP''^{T, g, m) < CQl'\T, g, W, m) and hence the lemma. □ 



*^To see this, we can use the "pinning coordinates" in | 171 §3.3 and p. 163]. 
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3.3. The expression fi'^{T,g). We next introduce an exponent fi'^iT^g) 
due to Kitaev [ITj, using partitions of unity. A finite family $ — {(pui}ujen of C°° 
functions on X is called a partition of unity for V \i Q < (j)^{x) < 1 on X, and 
Si^GO 4'uj{x) = lonV. The diameter of $ is max^^gnldiam (supp(0^) n V)}. For 
a partition of unity (f> and an integer m > 1, set 

m — 1 



k=0 



which is a partition of unity for D^^qT ''{V). For g G C'^iV), the sequence 



||^-5('"^-A(f^'''").detpT"b.)-'ll 



is then submultiplicative with respect to m if q < < p, so that we may put 

pr(r,ff,<i>)= lim (p:^'(r,g,<i>,m))i/'" . 

m — 'oo 

An important estimate due to Kitaev is: 

Lemma 3.7 (Kitaev [17 ). Let q < < p. For every partition of unity $ for V 
of sufficiently small diameter and each g S C^{V) with 6 > 0, we have 

(3.7) pP''>iT,g,^)^pP'^{T,g). 

This lemma implies that p^'''(T,g, $) takes a constant value for any sufficiently 
fine partition of unity <!>. This value is denoted by p^''^{T,g). 

Remark 3.8. In [171 Lemma 2], the corresponding claim is actually stated for 
"regular mixed transfer operator (MTO)". To get Lemma [3771 we apply that claim 
to the regular MTO induced by T and g, using local charts and partitions of unity. 
See [IT] and Remark l?TT] 

Remark 3.9. In Lemma \3l\ we can prove pl'''{T,g,<^) > pP''>{T,g) without 
much difficulty, using the argument as in the proof of Lemma [3.6l But the inequality 
in the opposite direction and exactness of the limit in the definition of pP'''{T,g) 
are not easy to prove. In general, the functions X^P'I'"^") (x) for large m depend on 
X irregularly, so that we may not use a simple argument. 

We finally prove Lemma \TM 

Proof of Lemma 11.41 By Lemma 13.51 and 13. 6[ we have only to show that 
pP''^{T,g) > QZ'''{T,g). We start by a preliminary observation: For any integer 
fc > 1, we have 

(3.8) gr(T^ff('=)) = (Qrm5))' and /■'?(T^ gW) = (p^'-^(T, 5))^= . 

The former follows from Lemma 13.51 The latter is a consequence of the definition. 

We take a partition of unity <I> = {4>i^}ujen of small diameter so that the in- 
tersection multiplicity of the supports of cj)^ is less than some constant Nd that 
depends only on the dimension d of X. Then W = {fc^((-^^^, 1]) | a; G fl} is a 
cover of V. We may assume it to be generating. Hence 

gP'^(r, g, W, m) < ■ pP^''{T, g, $, m) for m > 1 

and, by Lemma [5771 

Ql''{T, g) = Ql'^{T, 5, W)<Nd- ff^'^T, g) ^ N, ■ ff'^{T, g) . 



14 



VIVIANE BALADI AND MASATO TSUJII 



We may apply this estimate to and g'^''^ for fc > 1. Finally, we use both claims 
of for large k to obtain Ql'\T, g) < fi'^{T, g). □ 

4. Spaces of anisotropic distributions and transfer operators on W'' 

In this section, we introduce Banach spaces of anisotropic distributions on 
and then argue about the action of transfer operators on it. The argument in this 
section will be applied to iterates of our original diffeomorphism T and weight g, 
using suitable local charts and partition of unity. 

For a subset K C M"^ and < s < oo, let ^{K) be the set of functions 
u:W^ ^<C whose support is contained in K. Let C^{W^) be the set of u G C"*(M'') 
with compact support. Let C^iW'-) be the set of functions in C°°(IR'^) such that 
sup3,gRd \d^u{x)\ < oo for all /3 G The Schwartz space S consists of all 

u € C°°(R'') that are rapidly decaying, that is, supj,gjjd \x°'d^u{x)\ < oo for all a, 
P G {l+f. So C^{M.'^) CS C C^iM.'^) C C~(R''). 

4.1. Definition of local spaces. The basic idea in the definition of our 
anisotropic spaces of distribution is to slightly modify the classical Littlewood-Paley 
dyadic decomposition of functions in Fourier space, by introducing some cones of 
directions, or "polarizations". This approach was introduced in our previous paper 
[^. Below we modify the definitions in [7] slightly in order to get the improved 
bounds in Theorem ll.il (See also 1121 for a recent Fourier analysis approach in the 
analytic setting.) 

For two cones C and C in R'^, we write CdC if C C interior (C) U {0}. Let 
C+ and C_ be closed cones in M"* with nonempty interiors. Assume that C+ D 
C — {0} and that C+ and C_ contain some dg- and d„-dimensional subspaces, 
respectively. Let (p^,(p^ : S'^^^ [0, 1] be C°° functions on the unit sphere S''"^ 
in M.'^ satisfying 




We shall work with combinations = (C+, C_, (^_) as above, which are called 
polarizations. 

To a polarization 8 as above, we associate the set .F = .^^(6) of all C^- 
submanifolds C K"*, of dimension c?„, so that the straight line connecting any 
two distinct points in F is normal to a dg-dimensional subspace contained in C-|_. 

Remark 4. 1 . Our assumption on implies that, if we take a d^-dimensional 
subspace E that is normal to a c?„-dimensional subspace E-^ C C_, then the pro- 
jection TT : R'' — > M.'^/E is a diffeomorphism when restricted to G ^{Q)- 

For u G C°°(R'') and T = T{e), we set 

(4.1) = sup e R u {oo} , 

where /li? is the Riemann volume on F induced by the standard metric on M.'^. 

The following lemma will play the role that the usual Young inequality for 
convolution played in [7]: 

Lemma 4.2. Let T = J^{Q). Then we have 

< forueC^iR'') andAeL^R'') 
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where * denotes the convolution, A * u{x) — /j^^ A{y)u{x — y)dy. 

Proof. Take F E J- arbitrarily and let F + x be the translation of F by 
a; e M'', which also belongs to !F. Then we have 

\\{A*u)\\li(^,^) < J^(^J^JA{y)\ ■ \u{x - y)\dy^ d^XF{x) 
\A{y)\ (^J^Hx ~ y)\dfiF{x)^ dy 
< J |A(y)| • ||u|Ui(,,^_jdy < 
where we used that iip-y is a translation of fip. □ 

We next introduce some notation in view of performing a dyadic decomposition 
in the Fourier space. Let = (C+, C_, be a polarization. Fix a C°° 

function x : K — > [0, 1] with x(s) — 1 for s < 1, and x(s) — for s > 2. For n G Z_|_, 
define Xn'.^"^ [0, 1] by x„(?) = x(2~"|CI), and put X-i = 0. Set : K'^ ^ [0, 1] 
to be ipniO = X«(C) -Xn~i(C), for e Let F = {{n,a) \ neZ+,a e {+, -}}. 
For (n, (t) G F, we define 



MO^A^/\C\), ifn>l, 
MO/2 = xo(e)/2, if n = 0. 



Then the family of functions {4'e.n.a}{n,a)er is a C°° partition of unity. Note that 

the inverse Fourier transform V'e.n.o-la^) = (27r)~'' J e"^'0e,n.cr(C) '^^ of each V'e.n.cr 
belongs to 5, and satisfies the following scaling law: 

(4.2) ^e,nAx) = 2^("-^)^e,i,-(2"^'^) if n > 2. 
In particular, we have 

(4.3) sup \\'$e,n,ALHR'') < oo. 

(n,o-)er 

We may decompose u e C§°{R'^) a.s u — J2{n cr)er ^e.n.cr, by setting 

Remark 4.3. For i/j G 5, we define the pseudodifferential operator ip{D) : S — > 
5 by 

i;{D)u{x) := (27r)-'^ / e'^^''-y'^ip{£.)uiy)d^dy ^ $ * u{x). 



We may write this operation as ip{D) = ¥^'^ o A£^, o F using Fourier transform F 
and the multiplication operator by ip. From the expression as a convolution 
operator, we may extend it as an operator ip{D) : C^iW^) — * C^(R''). We will 
often use the fact that 

(4.4) V'i(-D)V'2(£') = (iZ-i •V'2 )(£>), -01*^^ = 1/57^2 fori/'i>2e5. 

Here we quote the following lemma from [7] , which tells roughly that the func- 
tions ipQ^n,a{D)u decay rapidly outside of the support of u G C^{M.'^). 
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Lemma 4.4 (O Lemma 4.1]). Let K C be a compact subset. For any 
positive numbers b, c and t, there exists a constant C > such that 

(4.5) \i.e^.AD)u{x)\ < C d{.,snMu)f 

for any {n,a) G F, m G C°°{K) and x £ satisfying supp(w)) > e. 

Remark 4.5. Since %l)ejAD)u = xe+i{D)tp0^i^r{D)u = xe+i * ■>Pe,e,r{D)u, we 
have 

UeAriD)u\\L^ < C2'^^||^e/,r(i^)u||Li(^(e)) for any (£,t) e F and m G Cg°{WL''). 
Therefore we may replace the L°° norm in (|4.5p by the norm || • ||^i(;r(e))- 
For a polarization O, real numbers q < < p and u G C^{M.'^), we define 



(4.6) llwllce.p,, = max<^ sup 2P"||Me,«,+ ||Li(jr(e)), sup 2«"||ue,„-||Li(jr(0)) 

L n>0 n>0 

Consider a non-empty compact subset JsT C M''. We first check that the definition 
above gives a norm on C°°{K). Let || • \\c= be the usual C norm on ^{K). 

Lemma 4.6. For any s > p, there exists a constant C ~ C{s, K) such that 
llwllce.p,, < C\\u\\cs for all u G C^{K). 

Proof. We may assume that s is not an integer. Recall the following character- 
ization of C" norm in terms of Littlewood-Paley decomposition (see [26[ Appendix 
A]): For non- integer s > 0, the C norm is equivalent to the norm defined by 

||u||c= :=sup(2^"||V„(i?)«||i..) . 

n>0 

Since ipe.n,aiD)u = J2m:\m-n\<i ^e,m,cr * (V'ri(-D)u) by (g^) , wc have 

(4.7) Ue,n,a{D)u\\L^ < C\\iP„{D)u\\l^ for any {n,a) G F 

by Young inequality and (|4.3p . Using Lemma l4^ with (|4.7p . we estimate tpe,n.cr{D)u 
outside some neighborhood of K and obtain 

Ue.nAD)u\\m^) < C{s,K) ■ 2-^"i|M||c; for any (n,a) G F . 
Clearly this implies the lemma. □ 

We may now give the definition of our anisotropic space of distributions. 

Definition. For a polarization 8 = (C+, C_, (^+, </?_) and real numbers q < 
< p, set C^'P''^{K) to be the completion of C°°{K) (or, equivalently, that of 
C^{K) with s > p) with respect to || • ||ce,p,g. 

Remark 4.7. The only difference between the space Cf'^''^{K) in our previous 
paper [7] and the space C^'P''^{K) in the present work is that, in the norm 
II ■ IIli(.f) in the definition above was the norm. 

Lemma 4.8. For any s > \q\, the space C®'P''(if) is contained in the space of 
distributions of order s supported on K . 
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Proof. We may assmiie that s is not an integer. Take any u G C°°{K) and v G 
Cq°(R'^) and decompose them as u = J2{n,u)£r ^e,n,<y{D)u and v = I]„>o '^ri{p)v 
respectively. Since supp('0e,n.cr) H supp('i/'m) 7^ only if |m — n| < 1, we get 

J u-vdx = ^ ^ j 'll^Q^n,a{D)u{x) ■ Tpr,i{D)v{x)dx 

{rL,a)^T m:|m— n|<l 

by Parseval's identity. Using Lemma with Remark l4.5[ we estimate ipe,n,a{D)u 
outside some neighborhood of K and obtain 

u-vdx < CIlMllce.p.qllwjlcj- 
This implies the claim of the lemma. □ 
The decomposition introduced above can be viewed as an operator 
Qe : C°^{K) ^ 5^ u^ (ue.n.a := Ve,n,.P)^^) („ ^.^^p- 

Below we set up some Banach spaces for the target of Qq, in the place of above. 
For an integer n > 0, we define 

B^^{ue C'^iR") I Xn{D)u = u and h||Li(^(e)) < C C^iM.") . 

For each s > and n > 0, there exists a constant C(s, n) > such that 

(4.8) ||w||c- < ^(5,71)11^11^1(^(0)) foranyweB®, 

because d^u = (9"Xn) * f^- Hence B^ is a Banach space with respect to the norm 
II • hnne))- We have that B^^^ C by XniD)xn-i{D) = Xn-i{D). 

Definition. For a polarization 8 and real numbers g < < p, we define 

\ iun,a)(n,a)er "n.a £ B^+g, lim max 2'=('^^"||w„,^||ii(jr(e)) = ^ , 

I ■ n— *CXD (T — + ,— J 

where c(+) = p and c(— ) = q. This is a Banach space with respect to the norm 

\\iUn,a){n,a)€r\\BO,p,g := SUp ( 2'=''^)" || || Li ( j:-(e)) ) ■ 

^ (n,cr)Gr ^ 

Remark 4.9. The space Bp above is a closed subspace of the Banach space 



JDp 



Bp 



r 

e 



''''' = ^iun,a)(n,a)er n-n,a G B^+g and || (M«,CT)(„,£T)er lief < 00} 



with the identical norm |j • |jge,p,g. The space B^'^''" is slightly more convenient 



(4.9) B® := {{un,a)(n^a)eT \ u^.a £ B^^+3, #{(n, a) G r I W„,, 7^ 0} < 

is dense in Bp'^'"^ though this is not true for Bp'^'"^. The difference will also make 
sense in Proposition 16.21 and its proof. 

By (|4.4p . we have, for /c > 1, 

(4.10) Xn^k{D)^Q,nAD)^^Q,nA^) iW') . 

This and Lemma SH imply that Qe(C°°(i^)) C Bp'^'"^. Thus, by the definitions of 
the norms, the operator Qe above extends to the isometric embedding 

Qe : C®'?''«(i^) ^ B®'f'^ 



than Bp'^'* for us. For instance the subset 
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From Lemma 14.41 we can see that the image of the embedding Qq above is 

e, 
r 



contained in much smaller subspaces than Bp'*'"''. Indeed we can take a smaller 



Banch space Bp'^'"^ C Bp'^'^ that contains the image of Qe as follows. We set 
f3{x) = (1 + |x|2)('^+i)/2 and, for n > 0, 

B,^ ^{ue C°°(E'*) I Xn{D)u = u and ||/3 • u|Ui(^(e)) < oo} . 

In parallel to (|4.8p . there exists a constant C(s,n) > for each s > and n > 
such that 

(4.11) \\(3-u\\c^ <C{s,n)\\(3-u\\m:F{e)) for any u e B^. 

In particular, B^ is a Banach space with respect to the norm u ^ ||/3u||ii(jF(e))- 
Definition. For a polarization 8 and two real numbers q < < p, we define 

Un,a e B,^, 2> lim max 2'=('")"||/3 • u„,^||Li(.F(e)) = I 
where c(+) = p and c(— ) = q. This is a Banach space with respect to the norm 

\\{Un,a){n,^)er\\^^.P.i SUp ( 2'=('')" || /3 • U„,<, || (jr(e)) ) • 

^ (n,cr)er ^ ^ 

Obviously the inclusion l : Bp''"''' ^ Bp'^'* is non-expansive. 
Lemma 4.10. Qe{C^''''''{K)) c Bp'^''. Qe : C^'P'HK) Bp'^'' is bounded. 

Proof. By (|4.10p for A; = 2 and by Lemma 14.41 with Remark 14. 5[ we can 
see that i/'e,n,cr(-D)(C°°(i^)) C B^_,_2 and that ||(5e'"|lB^"'« ^ IIQewllB^-p-" - 
C||(3eu|lB^'P" ^ C°^{K), for some constant C. This implies the lemma. 

□ 

4.2. Transfer operators associated to cone-hyperbolic maps. In this 
subsection, we define regular cone-hyperbolic maps on bounded open subsets of M.'^ 
and consider transfer operators associated to such maps T and C"""^ weights G. 

Definition. Let U and U' be bounded open subsets in M'' and let 6 — 
(C+, C_, (^4-, ip-) and 9' = (C^, C'_, ip'^, ip'_) be two polarizationq^. A C diffeo- 
morphism T :[/'—>[/ is regular cone-hyperbolic with respect to polarizations Q and 
6' if r extends to a bihpschitz diffeomorphism of M'' so that DT^''{R'^\C+)^C'_ 
for each a; S K'' and, in addition, that there exists, for each x,y ^ M.'^, a linear trans- 
formation L^y satisfying {lL^yy{R''\C+)(sC'_ andL^y(a;-y) = T{x)-T{y). (We 
denote the transposed matrix of A by A*"^.) 

If T is regular cone-hyperbolic, then the extension T to K'' maps each element 
of JF(0') to an element of ^{Q), from both conditions in the definition. 

Remark 4.11. The second condition on the extension of T in the definition 
above does not follow from the first condition. For example, consider a hyperbolic 
horseshoe map T, and let U he a small neighbourhood of the entire invariant 
horseshoe. 



^ We view C^^^-i-, _|_ as constant cone fields in the cotangent bundle T'R'', so we apply 
the transpose of DT to the vectors in them. 
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In the rest of this section, we consider the transfer operator 

(4.12) L : C-^U) -> C-^U'), Lu = G-{uoT) 

associated to a regular cone-hyperbohc C" diffeomorphism T : U' ^ U with respect 
to polarizations 8 and 8' as above and a C"""^ weight G E ([/'). 

We begin with a simple estimate on the operator norm of L with respect to the 
norms || ■ ||Li(;c-(e)) and || • ||ii(;r(e'))- Define 

|det(i:>r|c;)|(a;) inf |det(i:>r|L)|(a;) for a; G C/', 

where inf^ denotes the infimum over all d„-dimensional subspaces L C M'' with 
normal subspace contained in C^, and det{DT\L) is defined as for (|3.ip . Then we 
have, for any u e C"'~^(M'^), 



(4.13) 



Ili^ilkH^O')) < ||G|| 



sup (IdetDTIc: 

upp(G) 



l'"IUi(^(e)) 



Fix real numbers q < < p satisfying p ~ q < r — 1 henceforth. Below we will 



introduce an auxiliary operator AI : Bp'*'"'' 
diagram of bounded operators commutes, with L an extension of (|4.12p : 



Bp ''''^ and show that the following 



(4.14) 



^e.,p..q 
C®'P'«(C7) 



M 



B 

Se'l 



The operator M is an infinite matrix of operators, each of which describes the 
transition between "frequency bands" induced by L. 

We recall some definitions from f7]. We associate, to T and G, two integers 

^iax /lmax(^: Q and = h;^.^{T, G) 



by 



h+ 



l0g2 



logj 



sup sup 

a;esupp(G) U\\ = l 



inf inf WDT^^m 

2;esupp(G) 11511 = 1 



-6. 



Remark 4.12. We will consider the situation ft.+„^ ^ ^ h^- in application. 
This definition implies that, for x e supp(G') and ^ e R'', 



(4.15) 



P^x''(OII<2 



m\ 



„+5 



if Z?Ti'-(e) ^ C'_, and 
if^^C+. 



We next introduce the relation ^~^t,g on F as follows: Write {£,t) ^ {'n,a), 
for {£, t), (n, a) G F, if either 

• (r, a) = (+, +) and n < £ + 



or 



i^^ c^) = -) and i + < n, or 
(r, a) = (+, — ) and (n > h. 



mm ^ "max 
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Otherwise we write {£, r) y^■ (n, a). 

Take a closed cone C+(£C+ such that 

(4.16) DT^^'iR'' \ C+)^C'_ for x e supp(G) 

and another closed con _(eC_. Let Lp+, : S'' ^ — > [0,1] be C°° functions 
satisfying 

. ..^ fi, ife^s^-inc_; . ..^ fo, ifees^'-inc+; 
\o, ifeeS'^-inC_, ^"^^^ \i, ife^S'i-inC+. 

Put Vi£(0 = x(2"^"^||ell) -X(2"^+^||^||) for ^ > 1, and define, for (£,t) e T, 



y(2-i||C||), if^ = 0. 



Then V'e/,T(0 = 1 for ^ £ supp(i/'e,f,r) and (|4.3p holds with i/'e,r!,<T replaced by 
''pB.n.a- Further, by modifying the cone C+ if necessary, we may assume that 

(4.17) 2'*n"n+4||e|| < \\DT^''{£,)\\ for any x e supp(G) and any ^ i C+. 

From (|4?T5H4T7)l . there exists a constant C{T,G) > such that, if (^, r) 
(n, (t) and max{n,^} > C{T,G) for (^,T),(n, cr) e F, then we have, for all x G 
supp(G), 

(4.18) d(supp(V'e',n,.), i^r,*'- (supp(^e,f,r))) > 2"-'^{"'^}-^(^''^) . 

For each {£, r), (n, cr) e F, we define the operator S^^„ : — > B^^_;^ by 

S^^^u := ipe>,n,aiD) oLo ipQ^i^^{D)u . 
We begin with defining the operator M formally by 

(4.19) M((«„,,)(„,,)er) - ( E ^n>i.r 

To check that this formal definition gives a bounded operator M : Bp '^'"^ Bp 

we recall from [7j a few estimates on the operators 5*^'^- E)efine the positive- valued 

integrable function & : R'* ^ R by 

(4.20) 6(x) = l if||.T|t<l, b{x) ^ \\x\\-'^-'^ if ||a;|| > 1. 
For m > 0, we set 

(4.21) b„^ : R'^ ^ K, b,n{x) = 2^^" • 6(2™a;) , 

so that ||6t?i||li ~ II^IIli- There exists a constant G > such that 

(4.22) bn * bm{x) < C ■ 6min{n,m}(2;) for any a; G R'' and any n,m > 0. 
By (|4.2p . there exists a constant G > such that, for any x e R'' and {n, a) £ F, 

(4.23) \ip0,n,a{x)\ < C ■ bn{x) and jV^e „ <,(a;)| < G • 6„(a;) . 



^^Actually C_ will not play any roll in the following. One may set C_ 



DYNAMICAL DETERMINANTS AND SPECTRUM 



21 



Lemma 4.13 ( 7, (27)]). There exists a constant C'(T,G) > 1, which may 
depend on T and G, so that, if {£, t) {n, a) for {£, t), (n, a) G T, then we have 

(4.24) |5^;;u(x)| <C(r,G).2-('-i)--{"'^> / b^,^{^j^^{x - y) ■ \u{T{y))\dy , 

for any u e C^{W^) and xeW^. 

The proof is just a few applications of integration by parts using the estimate 
(|4.18p . For convenience of the reader, we give the proof in the case when r is an 
integer in Appendix [Cl 

Lemma 4.14. There is a constant C > 1, which does not depend on T nor G, 
so that, for any {£, r), {n, ct) G F and any u G B^g, it holds 

(4.25) ||/3-5f;>|Ui(^(eo) <C-||G|U~. sup (| detI?T|c; P') ■ |k||Li(^(e)) • 

supp(G) 

Further there is a constant G{T, G) > 1 so that, if {£, t) (n, a) in addition, then 

(4.26) 11/3 • ^^-^^lUif^feo) < C{T, G) ■ 2-('-i)--^"^^>||«|Ui(^(e)) . 
Proof. Lemma H?^ and (14. 3p give the estimate 

llV'e',£,T(£')u||Li(jr(e')) = yJe',e,T *u\\L^j^{e')) < C||w||Li(jr(e')) 

and the parallel estimate for ipe,e,T{D). The claim (|4.25p with (3 replaced by 1 
follows from these estimates and (|4.13l) . The claim (|4.26p with /3 replaced by 1 
follows from Lemma |42l 14.131 and (|4.13p . To put back the factor /3, useE^ the 
following consequence of Lemma 14.41 and Remark 14.51 For any e,c,b > 0, there 
exists a constant C > such that 

|5f;,;u(x)| < C ■ d{x,W)-' ■ 2-="^'^'^^"'"'}||^^f.,^^|Ui(^(e')) 

(n',dr')er 

for all x(^W^ with d{x, TP) > t. □ 

Remark 4.15. The constant G in (|4.25p depends only on the polarization 8' 
and the family of functions {f/'e,f,T}(£.T)er- On the contrary, the constant C(T, G) 
in (|4.26p and (|4.24p depends heavily on T and G. 

Corollary 4.16. The formal definition {4^.19^ gives a hounded linear op- 
erator M : Bp'^''^ Bp The transfer operator L extends boundedly to 
L : C^'P'i{U) C®'^P''?([7'). The diagram gjjp commutes and M(B^''') C 
Qe'(C®''^'nf^))- 

Proof. The first claim is an immediate consequence of Lemma [4.141 and the 
definition of the relation It is then easy to check that M o Qq = Qq, o L on 
G°°{K). RecaUing that Qe' : C®''P'?(I7') ^ Bp''^'« is an isometric embedding, 
we get the second claim and the commutative diagram (|4.14p . Since M(Bp) C 
Qe'(C°°(C7')) for B^ defined in gU, we get the last claim by density. □ 



^^For 1 14. 261 1. use also the fact that there exists constants C{T, G) < C'(T, G) such that the 
relation {£, r) ^ (n, a) holds if an - < C{T, G) and only if an - tK C'{T, G). 
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In view of the argument above, it is natural to decompose the operator M into 

\(£,T):(^,r)^(n,CT) 

and 

By the same argument as in the case of M, we can check that the above definitions 
in fact gives bounded operators Mb-, Mc : Bp'*'"'' Bp and M — Mb + Mc- 
Using Lemma [4.141 and the definition of the relation ^ more carefully, we gelF^ 

Lemma 4.17. There exists a constant C > 0, which does not depend on T nor 
G such that the operator norm of Mb '■ Bp''''^ — s- Bp '^''^ is bounded by 

C-\\G\\l^ ■ ( sup IdetDTIc TM ■ 2"^^'^^P■''--9•^"n}. 

4.3. Approximation numbers. We shall study approximation numbers of 
the operator Mc and show, in particular, that Mc is compact. First we recall some 
basic definitions and facts about the approximation number from [22 . Suppose 
that B and B are Banach spaces. For k G we define the k-th approximation 
number of a bounded linear operator V : B ^ B hy 

OkiP) ^ inf{||7'-F||B : F -.B^B, rank(F) < k} . 

For 1 < t < cx), let c'f'\B, B) be the set of bounded linear operators V : B ^ B such 
that (afe(7'))fc6z^ G For each V G C^^\b,B), we set WVW'f^ := \\{ak[V))\\it. 

Suppose that "Pi : Si — > B2 and V2 '■ B2 B3 are bounded linear operators 
on Banach spaces. If Vi G c't'\Bi,B2) (resp. V2 G c[''\B2, B3)), then r2Vi e 
c[°'\Bi, B3) and we have 
(4.27) 

\\V2Pit^ < \\r2\\LiB.,B,)\\Vit^ (resp. \\V2Pit^ < \\V2t^\\V^h^r,.,s.^ ) 

where ||P|lx,(/3 g) denotes the operator norm of a linear operator V : B ^ B. For 
t, t' , s G [1, 00] such that 1/t + 1/t' = 1/s, there is a constant C > so that 
(4.28) 

\\V2ri\\i''^ < C\\V2\\[f^ ■ llT'illi"' for Vi G ci''\Bi,B2), V2 e 4?\B2,B3) . 

The next lemma tells that the operators in c'f'\B, B) have nuclear representations: 

Lemma 4.18 ([22l Proposition 2.3.11]). There is a constant C > such that, 
if V E C^^\b,B), there exist sequences Vi G B and v* E B* , i E Z+ , such that 
-P = E,^.®< ^nd HU\\v*\\b < C\\Pt\ 

Remark 4.19. We refer |22j, 2.2-2.3] for more explanation about approxima- 
tion number. In particular, we refer 2.3.3 and 2.2.9 of ^ for ((07)1 and 
respectively. 

We now return to the operator Mc- 

^■^We refer the proof of [7, Theorem 6.1] for details, though it will not be necessary. 
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Proposition 4.20. The operator Mc : Bp'*''^ Bp in the last subsection 
belongs to (Bp Bp '^'^) for any t > d/{r — p + q — I), and is hence compact. 

For the proof, we prepare the foUowing approximation lemma: 

Lemma 4.21. Let K C M"^ be a compact subset and let Q be a polarization. 
Let s > and e > be positive real numbers. Then there exists a constant C > 
such that, for each N > and {n, a) E T with n < N , there exists an operator 
FnM,N ■■ C-^K) B^_^2 of rank at most 2(1+^)''^, so that, for any u G C^-^iK), 

(4.29) 11/3 • {'^e^nAD)u - F„,,,jv u)||Li(^(e)) < C2-^^||u|Ui(^(0)) . 

Proof. We may assume that K C (-1,1)''. Let (j) : ^ [0,1] be a C°° 
fmiction so that = 1 on [—1,1]'' and (/> = on outside of [—2,2]'', and put 
0a (0 — '/'(2^°0 for a > 0. Take arbitrary e > and consider iV > and (n, ct) G F 
with n < N. 

For u e C""~^(i4r), put H{u) = 4>^n ■ Tpe,n,aiD)u = 4>^n ■ ipe.n.a * u. Since 
the distance between K and supp(l — (j>eN) is greater than 2'^ — 1, there exists a 
constant Cs > for any s > so that 
(4.30) 

II/? • {H{u) - ^0,nAD)u)\\LHne)) < Cs ■ 2-^^||^/|Ui(^(0)) for u e C^-^K). 

Since H{u) for u G C'^~^{K) is supported on (—2'^^+^, 2^^+^)'', we may regard 
it as a function on ]R''/(2^'^+^Z)'' and consider the discrete Fourier coefficients 

c„(u) = (2^^+2)-''/2 f e^"^i/(u)(x)dx for a G (2-'^-i7r) • Z'* . 

Set 

F{u){x) = 9i,jv+i(a;) • ^ Ca(u) • e*"^ for u G C"-i(X). 

|aj<2«+5 

Then the difference H{u) — F{u) is supported on (_2<=^+2^ 2'^^+^)'' and satisfies 
(4.31) \\f3-{H{u)~F{umL^ < I sup /3 ) • V |c„(u)| . 

We may write the coefficient Ca{u) for a G (2"'^^~^7r) • Z"* as 

(2.JV+2)-d/2 . F(iJ(u))(a)(2^^+2)-'^/2 . (F(<^,jv) * (^e,„,. • F(u)))(a) 

where F denotes Fourier transfrom. We have that ¥{(j)^N)iO = 2'^'* • F(/>(2'^^^) 
with ¥(j) e S and that ||F(u)||loo < ||u||ii < C{K)\\u\\Li{y^{e))- Also we have 
|a - CI > 2"i|a| > 2^+'' if C e supp(V'e,n,^) and |a| > 2^+^ Therefore, for any 
s > 0, there exists a constant Cs > such that 

|ca| <a-|«r^hlUi(^(e)) if |a|>2^+5. 

Using this estimate in (|4.3ip and recalling (|4.30[) . we find a constant Cs > for 

each s > so that 

(4.32) 

11/3 • {i^e,n.AD)u - F{u))\\m^ie)) < Cs ■ 2-^^||zi||ii(^(e)) for u e C-^K). 

Finally put Fn^a,N{u) := Xn+i{D){F (u)) for u G C"^"i(ii:). The rank of the 
operator Fn^a,N or that of F is bounded by 

#{a G 2-^^-V • Z"^ I |a| < 2^+^} < C2(i+^)'^^. 
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It is not difficult to sec that there exists a constant C > such that 

11/3 • Xn+i{D)v\\mr(e)) < C\\P ■ v\\m:FiB)) for any n > and v e C§°{R''). 
Thus the claim (|4:29l) follows from ([4T0| and (gSl): 

11/3 • {■lp0,n,a{D)u - K,fT,Ar(w))||il(:F(e)) < C • ||/3 • {lpe,n,a{D)u - F(M))l|Li(jr(e)) 

<C7,-2-^^hlUi(^(e))- 
From (|4.29p and the relation Xn+2{D)xn+i{D) = Xn+i(-D), the image of FnM,N is 
contained in B^_|_2- □ 

Proof of Proposition 14.2(11 We first approximate the operators S'^''^^ de- 
fined in the last subsection by finite rank operators. By Lemma l4?2l and (|4.13|) . we 
have 

||^o'0e,£,T(£')w||Li(jr(0/)) < C(T,G')-||-u||ii(jc-(0)) for any (^,t) e F and m G Bf^g. 

Take arbitrary e > and let iV > 0. Applying Lemma 14.211 to approximate the 
post-composition of V'e',n,cr(-D), we find an operator F^'J : of rank 

at most 2(1+')'^^ for each {n,a), {i,T) G F with n< N, such that 

(4.33) 11/3 • - F,^;;H)|U.(^(e')) < C{T^ G) ■ 2-('^-i)^h|U.(^(e)). 

Define Pat : B^'* -> B^'* by 

'w((u£,r)(£,r)er) = I E ^"^("^.^) 

(n,(T)er 

where P^'^J = F^^;^ if max{n,^} < A'^ and (f,T) {n,a), and = otherwise. 
The rank of Pat is bounded by C • A^^ • 2(1+'=)'^^. By and the claim of 

Lemma [4. 141 we obtain 

||A4 - IPiv||^(Be,p„ ge'.p,,) < C{T, G, e) ■ 2-(--P+?-i-^)^ . 

This implies that afc(Mj < C2~'^'-p+'i~^~'^^ for fc [C ■ A^^ . 2(1+0^^] + 1^ so 
that ||(afe(Mc))||£t is bounded for any t > d{l + e)/{r — p + q — 1 — e). Since e > 
is arbitrary, we get the proposition. □ 

5. The transfer operator C and its extensions 

In this section, we study the transfer operator C = £T,g for a C diffeomorphism 
T : X — > A" and a weight g G G^~^{V), within the setting in Section [1] Using local 
charts and a partition of unity, we associate to £ a system JC of transfer operators 
on local charts and then introduce a key auxiliary operator A4 . Once we define the 
operators K. and M and check their relations to C, the proof of Theorem 1 1.1 1 is an 
immediate consequence of the argument in the last section. 

5.1. Local charts adapted to the hyperboUc structure. We first set up 
a finite system of C°° local charts on V, and of polarizations on each of the local 
charts, so that they are adapted to the hyperbolic structure of the dynamical system 
T. Consider G°° local charts {(Kj, Kcj)}c^eo, with open subsets K; C A' and maps 
: ^ M'' such that V C UcjVL, and consider also a system of polarizations on 
those local charts {Qu = iCuj,+ , Clj.-, 'Pu,+ , </5w,-)}wen- Since T is hyperbolic on 
A, we may assume that the following conditions hold: 
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(a) V — {VLjweo is a generating cover of V and there is no strict subcover. 

(b) Uui — is a bounded open subset of R'^ for each w g fi. 

(c) If X G n A, the cone (Z)K(^)J(C(^.+) contains the normal subspace of 
i?"(a;), and the cone (Z^k^^)* (d^^-) contains the normal subspace oiE^{x). 

(d) If K,/^ = T-i(K;) n K.' 7^ 0, the map in charts 

is a C" regular cone-hyperbolic diffeomorphism with respect to the polar- 
izations and Quj'- 
Let $ = {(pui} be a partition of unity for V subordinate to the cover {VL,}i^go, 
that is, the support of each (p^ : X ^ [0,1] is contained in V^, and we have 
Swesi 4>ui{x) = 1 for all x & V . We will henceforth fix the local charts, the system 
of polarizations and the partition of unity as above. We may now define the space 
CP'<i{T,V) of distributions: 

Definition. The Banach space CP''^{T, V) is the completion of C°°{V) for the 
norm 

M\cp.i{T,v) = max 11(0^ • ip) o Kj^llce^.p,, 



where the norms || • ||ce^.p,5 are those defined by (|4.6p . 

By Lemma l46l and l48l the space C^''^{T, V) contains C"*(F) for each s > p and 
contained in the dual of C'^{X) for each s > \q\. 

We decompose the iterates C™' of C as follows. Take [3 a positive- valued C^~^ 
function g : X ^ M. such that g{x) > \g{x)\ for x € X. For each m > 1, choose a 
subset rim C ri™ so that 

V™ := {Vc^ := n^o^T-XK..) | ^ = (^c^i, ■ • ■ e f^™} 

is a cover of Hl'!^^ T~'^(F) by non-empty open sets and that (recall (|3.2p ) 

/ |^(™) I • \iP'i'™) 

.en^ VldetPT-l,.)! 

Take a partition of unity $,„ = {0^ £ C°°(X<3) N e f^™} for flLV ^-''(V') 
subordinate to V,„. Then we have £™ = X]c3ef2 '^3* ^'^^ operators 

: C'-^V) ^ C'-i(F), rS'^ = 0cD • g^"^ • ^ o T" . 

5.2. The system of transfer operators on local charts. We introduce the 
operator K. as follows. For each a> G il, take a C°° function /i^^ G (^""(C^^) so that 
< /i^ < 1 on M'* and that h^ = lon K^(supp(0,^)). Set C^"^ = 0^^^^ C"^-i(I7;;). 
We define the operators : C-^iV) Cl^^ and : ^ C"-i(^) by 

= ((0a; • W) O Kj^)^6n and g((Ma,)a,go) = (/tg; ■ ttg;) O . 

Obviously we have H o = Id. For each m > 1, we define 



Remark 5.1. The operator A^™ can be regarded as a regular MTO in the sense 
of Kitaev [17]. 



^•^We need to take the function g in treating the case inf \g\ = 0. Otherwise we may set g = g. 
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Then /C™ is the m-th iterate of K. := K} and the following diagram commutes: 



(5.1) 



Likewise, for m > 1 and to £ r2,„, we define the operator /C™ by replacing £ by £™ 
in the definition of AC™. Then we have AC™ = Vl-^o AC™ and the commutative 
diagram above holds with £™ and AC™ replaced by £™ and AC™ respectively. 
We can describe the operator AC™ as follows. Set 

Ua,u.'u. ■■= f^u^'iy^' n K; nT-™(K.)) 

and define T™^ : Us ^C^~\Ua,^.^) by 

= ° r™ o ^J/, G^,^,^ = ((0^, . 0^ . 5(™)) o K-i) . (/j^ o Tl^,J. 
For £ il, we define 

Then these operators are wtj'-components of AC™ : 



We will apply the argument in the last section to L = {IC^)ujuj>, setting 

(5.2) T — r^^,^, G = G^^i^'^, Q = 01^, & = Quj'i 

For this purpose, we have to choose cones Cuj,+ <^C^^+, C(j,_<eCi^,_ for each to £^l, 
so that, for any m > 1 and lo G fi™, if we set 

(5.3) C+ = C^,+ and C_ = C^,_ 

in addition to (|5.2[) , the conditions (|4.16[) and (|4.17p hold. Clearly this is possible if 
we take Ccj,+ sufficiently close to C^^^. We then choose G°° functions (^^^,4., (^^,_ : 
S'*"! [0,1] and define ^e^,n,o- & Cg°{R'^) in the way parallel to that in the 
definitions of and V'e,n,o- in Subsection [421 When we refer the setting ()5.2p 

in the following, we understand that it includes the additional setting (15. 3|) and 



(5.4) (p+^ipu>.,+, (p-=(pu,,~ and ■0e,n,o- = ■0e^,n,(T for (n,(T)e P. 
Consider the Banach space 



with the norm ||(W[i;)[i;gr2||c''''' — '<^^'^L,jen\\uuj\\c^u,.p,i- By the definitions of the 
norms, the operator extends to an isometric embedding : CP'^(F, T) C^'^. 
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Corollary 14.161 applied to the setting ()5.2|) tells that the diagram (|5.1|1 extends to 
the following commutative diagram of bounded operators: 



CP'J{V,T) 



Taking the sum with respect to we get the same commutative diagram with £™ 
and IC^ replaced by £™ and KT. 

5.3. The auxiliary operator M.. We next introduce the auxiliary operator 
M as follows. Recall the Banach spaces Bp'*'"'' in the last section and consider the 
Banach spaces 



with the norms 



||(u„)ajgn||BP,'« := max||u^|Le^.p,, , \\{n^)uj(in\\%P-i := max ||u^l|ge^,p,. 
Let Q : Cf^"^ B^'' be the isometric embedding defined by 

Applying the construction in Subsection 14.21 to L ~ {IC^)^^^^' in the setting 
we define the operator 

for uj G rirn and lo^lo' G 51, so that the following diagram commutes: 



(5.5) 



CCS-). 



Qe 



We define the bounded operator 7W™ : B^'^ — » B^'' by 



and put Ai"^ — J^sen -^3'- Then we obtain the following commutative diagram 
of bounded operators: 



(5.6) 



and the same diagram with C^, K,^ and replaced by /I™, /C™ and 
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By using continuity of A^™, we can check that A4™ is the m-th iteration of 
M:=M^ and thaQ 

/C"(CP''') C $4CP''?(T,l^)) and A^™(BP'«) C QIC^^"^). 

This and (|5.6p imply that the spectral properties of C on CP '^{T, V), IC on C^'' and 
A4 on B^* are (almost) identical. More precisely, the essential spectral radii and the 
eigenvalues of modulus larger than the essential spectral radius coincide, including 
multiplicity, with an isometric bijection between the generalised eigenspaces. 
Recalling Subsection 14.21 we decompose the operator M = {J^V)^^, into 

M6 = ((A^5'W)b and = ((A13^)^^0c : B^-^f^^ ^ B®-"^'". 

From Proposition 14.201 the operator {{A4^)ljuj')c is compact. From Lemma [4.17[ 
it follows 



,i(B«c..P,, B^.'--) - infv^ det(DT™|Eu) 



We decompose : B^'" ^ B^'" into (TW^Ob, : B^'« ^ B|^', by setting 

(A^S');.((Uc.)c.eo) = ( E((-^")-')buJ 

and similarly for {M^)c- Finally we put 

iM"^)b^Y.i^^)b (A^'"), = ^(A^5'), :B^/^B 



p.q 
z 



so that A^™ = (y\/(™)b + (A^™)c. Then the operator (A^™)c is compact and 

(5.7) ll(-M").|l.(Br,B,, ^ ^ • E infCS^i^^'l,.) • -P^^^'^'"^ • 

5.4. The end of the proof of Theorem ll.li Since the spectral properties 
of C on CP''^{T, V) and Ai on B^'' are (almost) identical as we noted, it is enough 
for the proof of Theorem II. II to show that the essential spectral radius of on B^'"^ 
is bounded by QP'*(T, 5) = Qt'^{T,g). Recall the positive-valued C"^ function g 
taken just before the definition of the subsets From standard argument in 

hyperbolic dynamical systems, there exists a constant C{T,g) > such that 

supy. , ^ . f g^"^ 



^^■^^ infy, I detW^lE")! - ^^^'^^ ■ \\det{DTr-\E^)\ 

for all cJ e il,n and to > 1 . It follows 

•supA^'^'^' ^<G(J,g)-sup 



infy_det(I?T™|E^.) ~ y."^ V I det(DT™|BO| 

Therefore we have, from (|5.7p . 

(5.9) li(>'™)6|li(B-,B-') < C(T,.9) •QP'«(T,5,V,to) . 

Since (7W")c is compact, the essential spectral radius of M : B^''' ^ B^'"^ is 
bounded by (C(T, 5) ■ g£'*(r, g, V, m))i/™ and hence by gS'''(r, g), letting to ^ 00. 



^^See the proof of Corollary 14. 161 for the second inclusion. 
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This holds for any C ^ function g such that g{x) > \g{x)\ on X. Therefore, by 
Lemma [3^ the essential spectral radius of M is bounded by Q*''^{T,g). 

Remark 5.2. We took a positive- valued function g (instead of j^l) so that (|5.8p 
holds. See Remark l3.9l also. 



6. The flat trace 

In this section, we discuss about a flat trace for operators P : B^^ B^^ and 
give some related results. 

6.1. Definition of the flat trace. Set Z ^ n xT. For ( = iuj,n,a) G Z, 
write 

niO^n, (t(C) = (t, LoiO^LU and ^(C) = .F(e„(o), 9(0-6^(0. 
Then the Banach space B^'"^ introduced in the last section is written as 



B-^ := {u,),^z 



^C^^ntil^ ^^lim^(2^('^K)MC)||,j|^,(^(^^j)^o 



where c{+) = p and c(— ) = q. We will regard each element u of B^'"^ as a family 
of functions with index set Z, and each will be called the ^-component 
of u. For E Z, let B^ (resp.B^) be the closed subspace of B^'' (resp.B^) that 
consists of elements (u^')^/^^ such that uq> = if C' Cj equipped with the 
restriction of the norm || • \\^p_-i (resp. || • ligp,?). 



Consider a bounded operator V : B^''^ B|''. For (, C' e Z, let T'cc : B 



C 



B^' be the bounded operator that send u € to the C'-component of P{u). 
Observe that the restriction of "P^^/ to B^; is written as an integral operator with 
kernel 

Kcc'ix,y) = 'PcC'(x«(c)+2(2/ - ■))ix) ■ 
Indeed, for it e B^, we have 

Vcc'uix) =rcc'{Xn{Q+2*u){x) = J PcC'(x«(c)+2(- ■u{y)dy. 

Since Xn(c)+2{' ^ u) belongs to B^ and depends on y G continuously, the kernel 
KQQi{x,y) is continous with respect to x and y. If Kqq{x,x) is integrable with 
respect to we say that Vqq admits a flat trace and put 



tr^(^C<) = / KQQ{x,x)dx. 



Remark 6.1. The operator P^^ may be expressed as integral operators with 
different kernels. And the different choice of kernels may give different traces for 

-Pec- 

Definition. We say that a bounded operator P : B^'' B^"^ admits a flat 
trace if "P^^ for each ( E Z admits a flat trace and if the following limit exists: 

t?P := lim V t?iPcc)- 

CMC)<n 



30 



VIVIANE BALADI AND MASATO TSUJII 



If "P™ admits a flat trace for all m > 1, we define the flat determinant of V to be 
the formal power series 



(6.1) det^fld - zV) = exp- V — t?{r 

^-^ m 



Clearly, if tr^(7'i) and tr''(7'2) are well-defined, then so is tT^{Vi + 'P2), and 
tr^(Pi)+tr^(P2) = tr^(7'i+7'2). 

Proposition 6.2. Suppose that V : B^* B^' is a bounded operator and 
has a nuclear representation V = TlTLi ® "^i where Vi S B^''' and v* € (B^'^)* 
satisfy Ik* ' lkrllB|''' < 00. Then V admits a flat trace. Further it holds 

00 00 
tv'V = and \tY^r\ < ^ ||z;,||gp., • |1<||b-' < 00 . 

1=1 1=1 

Proof. Put "P^*) = ® v*. Let for C S Z be the ^-component of Vi. Also 
let V* ^ be the functional on B^ that v* induces. Then we have V^^]- = Wi.^ ® 1^ 
and also 

(6.2) supIIv^.^IbJ' = Ikille^'' and ^ IKcUb^'' = IKIIb|''- 

By definition we have 

J-nC^) _ [ ^\rin, „.i,o,-„ 



trP^^-^ = y -K'cC ^) ^^em K).^{x, y) = ni^ci^)v*.^{xn{0+2{- " y))- 

Since Xn(c)+2(' ^ for y e is uniformly bounded in B^, we have, by (|4.1ip . 
that 

j \Kf^{x,x)\dx < C(C) • lli^.llgj^ ■ IKIIb-' for aU 1 < i < 00. 

This implies that K^^^{x, x) is integrable with respect to x, that is, Vq(^ admits 
a fiat trace. Since Xn(C)+2 * "^^i.c = "^i-C fo'' ''^'•C ^ ■^nK)+2' holds 

tr^P^'^' = u*,, (^J Vixix)xn{c)+2{- - a;) rfx^ = <^(wj,c) 



for each C G ^ and i > 1. It follows from (|6.2p that 

EE it'-'^c?! < EE ii-^xiiB-iKciiBr < Ell 

<IIb|-'II"«IIb|'' < 00 • 

Therefore we conclude that tr'''P exists and 

t'^'^-i™ E Et^Mc =EE<cKc) = E<(-^)- 

n(C)<n i i * 

The inequality for |tr'''P| is then obvious. □ 



^^For the second equality, recall Remark 14.91 This equality would not hold if we used the 
Banach space Bp in the place of B® '''''' 
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6.2. The flat trace of the operators A^™. We next consider the flat traces 
of the operators TW™, {M"^)b and {M"^)c introduced in the last section. The flat 
trace of Ai™ coincides with the dynamical trace: 

Proposition 6.3. The operator M™^ : B^'^ B^^'^ for m > 1 admits a flat 
trace and holds 



T-.(.)..'det(Id-I?T™(.))| 



Proof. Consider M"^ for m > 1. Take w e and uj e and recall the 
definition of the operator {M^)ujlj. Then we see that, for each ( ^ Z with uj{() — uj, 



the flat trace tr''(A47}) is defined as the integral 



^0(C)MOMO(^ ~ y) ■ • V'e(c),n(C),^(C)('^(y) ~ ^) ■ ^"(C)+2(^ - x)dxdydz 
where T and G are those in the setting (|5.2p with lo' — lo. Since 

V'e(c),n(C),^(C) * X«(0+2 * ^e(c),n(c),<T(c) = i^eiOMOMO 
by (|4.4p . we see that admits a flat trace and 

tr'(X^c) = / V^e(C),n(C),-(C)m^) - ^) ' G(a;) . 
Thus, for each integer no, we have 

(6.3) E tr^ (-^"c) = / Xno (^(^) - ^) • G{x) dx . 

C:n(Q<nQ;u}{C,)=uj 

The function Xno , regarded as a distribution, converges to the Dirac measure at 
as riQ —>■ oo. Note that there is at most one fixed point of T in supp(G) because the 
covering V is assumed to be generating. If there is no fixed point in supp(G), the 
sum (j6.3p converges to zero as no — > oo. If there is one fixed point xq in supp(G'), 
that fixed point should be hyperbolic by hyperbolicity of T and hence we may 
perform a local change of variable z = T{x) — a: in its small neighborhood to obtain 

G(xo) 



„li-^y ^«o(r(x) - .) • G{x)dx = -^^^^^ ^^^^^^^1 . 

Recalling the definition of T, G and h^^, we see that the operator A^™ admits a 
flat trace and 

t^^M^^^V V _ V- fe(x)-g(")(a;) 

o . |det(Id-i^r"(2;))| 4< |det(Id-OT™(x))r 

Taking the sum with respect to uj Cz we obtain the proposition. □ 

The following property of (A4"^)b is important in the proof of Theorem 11.51 

Proposition 6.4. There is L = L{T,g) > 1 so that, if nij > L for 1 < j < J, 
then 

n(-^"' )&) ==0 for all (eZ, 
Vj=i / CC 
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and in particular 

Remark 6.5. We read the expression H'l^iVi as the product Vk-iVk-i ■ ■ ■'Pi, 
not as P1V2 ■ ■ ■ Vk-i- 

Proof. By hyperbohcity of T, there exists L > 1, such that, for all u!,u!' € 
and uj £ flm with m > L, we have h^^^{T,G) < and G) > in the 

setting (|5.2p . This and the definition of the relation ^ imply that {M'^)b for 
m > L is "strictly lower triangular" as a matrix of operators in the sense that 
((X")&)CC' only if a{C)n{C) < <^{C)n{C)- Clearly this gives the claim of the 
lemma. □ 

For the operator (A^™)c, we have the following: Recall Subsection 14. 31 and put 

d 



(6.4) fc» = K{d,r,p,q) 



1 



r — p + q — 1 



Proposition 6.6. The operator {M"')c belongs to the class 4°^(B|'', Bl^"^) 
for any t > d/ (r—p + q — l). Further, given any bounded operators Vj : B^'*^ B^'"^ 
for < j < fc» and any integers ruj > 1 for 1 < j < k^, we have 



Proof. The first claim is a consequence of Proposition 14. 201 and the definition 
of the operator {M"')c- The second then follows from (liTTT)) and (g^S]). □ 

7. Dynamical determinants: Proof of Theorem 11.51 

In this section, we prove Theorem 11.51 Let g < < p be so that p — g < r — 1. 
As we noted in Subsection l5.3[ the operators AA on B^'* and C on CP''^{T, V) share 
almost same spectral data. And we have proved in Subsection 1 5 . 41 that the essential 
spectral radius of M is not larger than Q^''^{T, g) = QP''^{T, g). Fix e > arbitrarily 
and set p := Q'P''^{T,g) + e. By Proposition 16 . 31 we have dc{z) — det''(Id — zM.) as 
formal power series. Therefore, in order to prove Theorem 11.51 it suffices to show 
that dc{z) — det''(Id — zM.) extends holomorphically to the disc of radius p^^ , and 
that dc{z) vanishes at order in this disc if and only if 1/z is an eigenvalue of 
algebraic multiplicity Uz for A4 on B^'*. This is the content of the present section. 

Consider the spectral projector Va for M : B^''^ B^'"^ associated to eigen- 
values of modulus larger than or equal to p. We havcF^ ~ A4™ + A4^, with 
Mo = MVo and Mi = M{ld - Vq). For each m > 1, the operator A^™ is of 
finite rank and its image is contained in B^'''. By Proposition 16. 2[ M^ admits a 
fiat trace and its flat trace coincides with the usual trace defined for finite rank 
operators. By Proposition 16.31 we also see that A^™ = M"^ — M^ admits a fiat 
trace. Hence we may decompose 

det^(Id -zM)^ det\ld - zA^o)det^(Id - zMi) 



""^^Since (A4o)™ = A4"^Vo = (A^'")o, we write without risk of confusion, similarly for 

Ml. 
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and the factor det (Id — zA^o) is a polynomial which vanishes exactly at the inverse 
eigenvalues of AiVo, with order equal to the multiplicity of the eigenvalue. To 
prove Theorcm ll.Si it thus suffices to show that det''(Id — zA^i) is holomorphic and 
nowhere zero in the disc of radius p~^, i.e., for any e' > 0, there exists C > such 
that 

(7.1) \ti\MT)\ < C{p + e')" for all m > 1. 

Since the proof is much simpler in the case r > d+p— g+l, we will discuss about 
such case first in Subsections 17 . 1 1 and consider the other case later in Subsection l7.2l 
From (|5.9p . we may take an integer mo > 1 so that 
(7.2) 

II (■^'")&IIl(b^'' Z'™ and WM'^W^r^p., -^p,,. < p"^ for m > too- 
For m > 1, we put (7W™)a " (>'"')6 = (X"')c - Al" so that 

(7.3) = (A<'")a + (X")b. 



7.1. The case r >p — q + d+l. By Proposition 16.61 the operators (7W™)c 
and (7W™)a both belong to (B|'^ B|'') in this case. Write a large integer n as 
a sum n — to(1) + to(2) + • • • + TO(fc) with too < m(i) < 2too. Then, using 
we may write Mi — HiLi A^™^*^ as 

k k / fe i-i 

By Proposition 16.41 we have tr*" (jJi^i{M"^''^^)bj ~ for the first term. For the 
other terms, we have, by Proposition 16.61 with fc, = 1 and (|7.2[) . that 



/ k j-l 

t?l Yl A^7«-(A^'"(^'))a-[](X'"«)6 

\i=j+i i=i 

k j-l 

< n ll-^r^^^llB- • ||(A^'"(-''))alll"^ • n II(-M"^^^);>IIb|- < C(mo)p". 

i=l 

Therefore we obtain the claim (|7.ip . 

7.2. The case r < d+p — q + 1. In this case, the operators {A4"'')c and (A^™)q 
may not belong to C^i'\'B^^'' so we have to modify the simple proof in the 
last subsection. Recall the integer fc, = fc* (d, r, p,q) >2 from (|6.4p . 

Consider a large integer n and write it as a sum n = to(1) + to(2) + • ■ • + m{k) 
with mo < m{i) < 2too. Using (|7.3p . we write the product Ai" = Y[i=i as 

k 

(7.4) M^^ = 1[{M"^^% + Yl M{{j{im^i) 

i=l y<k, l<j{l)<j{2)<---<j{v)<k 

+ Y M'umf^,), 

i<i(i)<j(2)<---<j(fc.)<fc 
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where, setting j(0) = 0, 

k 

i=j{u) + l 1= 

and 

i=j(fc.)+l 



Remark 7.1. The decomposition above is obtained as follows. Consider the 



process to expand A^" = 0^=1 ''^i 
fc. For instance, we have 



m(i) 



using 



1,2,, 



Ml 



\i=2 J \i=2 ) 



for m = mil) in the turn i 



for the first step. When we find a term that contains {M.^ '''')a for fc, times, 
proceeding in this way, we stop expanding that term, obtaining the terms in the 
second sum in (17. 4p . The other resulting terms are collected in the first sum. 



From Proposition 16.41 the flat trace of the first term on the right hand side of 
(j7.4p is zero. Therefore, to prove (|7.ip . it suffices to show the following estimates 
for the other terms: 



(7.5) 

and 

(7.6) 



\tT'M\{jii)}t,)\<Cp" 
\t?M{{j{£m^,)\<Cp- 



By PropositionlUland we can see that M'({j(€)}^^J S /I^"' (B|'^ B|'*) and 

that the estimate ([73]) holds. Since (7Vl'"('))c 
the estimate (|7.6p follows if we show 



(A^™W)„ = M 



m{i) 



is of finite rank, 



(7.7) 



tr^l n iM"''^'^)b-Y[(iM 



m{i}\ 



n 

i=j(i/)+i e=i ^ i=ji£-i)^ 

In the following, we will work directly with kernels of operators to prove (|7.7p . 
Although the notation become a little complex, the argument is straightforward. 
Let y be the set of sequences {(jj(i), a3(i)}jL;^ with uj{i) G and uj{i) £ i^m{i)- 
For Y — {uj{i),oj{i)}^^^ G y and 1 < i < fc, we define the relation ^y.i on F as 
the relation ^t,g defined in the setting (15. 2p with uj = uj{i), lo' = Lu(i + 1) and 
uj = uj{i). (Put ui{k + 1) = w(l) in case i = k.) For Y = {Lj{i),uj{i)}'y^j^ e y, let 



Z(r) be the set of sequences {C(«)}?=i in Z''+^ such that C(fc + 1) C(l), that 

1))) iff i^J:={j{i)}U- 



uj{({i)) = uj{i) for all 1 < i < fc and that 

(n(C(*)),a(C(*))) -^Y,^ (n(C(* + l)),a(C(« 
Then, to prove (|7.7p . it is enough to show 



y={a;(i),<3(i)}*LieJ' {CW}Se2(y) 



tr" 



n(-^5?)cwc(»+i) 
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Let Y ^ {uj{i),uj{{)}ti e y and {C(^) - {io{i},n{i},a{i})f+l G Z{Y). By the 
definition, we have 

tr^ ^J|(X"(^')^)c(j)C(»+i)^ = j {^^K^{x^,Xi+i)^ dxidx2---dxk 
where we read Xk+i = x\ and put 



with 7; := '^'^^ ^» Ga(i),u{t^\)u>(i)- (Recall Subsection [5?1) Here 

we canceled the term x«(i)+2 by using i/'e^(i),„(i),<T(i) * X«(i)+2 = ''/'e^(i).n(i).<T(i)- 
For all 1 < I < fc, we have, from (|4.23p . 



\'Ki{x,y)\ < C ■ \\G^\\L^ J bn(i+i)iy-w) ■ bn(^i){Ti{w) -x)dw. 
Hi e J, we have, from (|4.24p . 

\K,{x,y)\ < C(7-,G,) •2-('-i)'"-{"«W)'"K(^+i))>5^in{„(CW)-(CC*+i))}(2/-^)- 
Therefore, using (|4.22p . we see that (X]!i=i{^^{i))c,(i)C,(i+i))\ bounded by 



C'' ■ C(mo)^- ■ Y[ 2-('-i)«>a-{«(»+i).«(«)} Y[ sup \g 



(m(i) 



K{k){%{xo) - Xk)-- ■ b^(^2){'h{x3) - X2) ■ 6^(i)(Ti(a;2) - xi) ■ ■ ■ dxk , 
where the constant C does not depend on the choice of mo while C(mo) may, and 

J min{n(i), n(i + 1)}, if i G J ; 

From hyperbolicity of T and the assumption that the covering V is generating, we 
may choose the extensions of the diffeomorphisms 71 so that the mapping 

S : (R'')^- ^ (xOti ^ (ri(x2) - xi,T2{x3) - X2, . . . ,Tk{xo) - x^) , 

is a diffcomorphism and satisfy 

inf I det DS\ >C-''-Y\ ( sup I det DT"'<-'^e'^ | | 

for a constant C > that does not depend on the choice of mo. Hence we get the 
following estimate for each term in (|7.8p : 



(7.9) 



k 

jm{i) \ 



trMn(-^3o')c«C(m) 

J 

Putting c(— ) = q and c(+) = p, we have, for i ^ J, 

c{a{i + l))n{i + 1) - c{a{i))n{i) < mm{p ■ h+^^{%,Gi),q ■ h^.^{%, G^)} . 
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We may assume that the right hand side is negative, taking larger toq if necessary. 
Since ({k + 1) = C(1)j we have 

(7.10) 

— ^^(t" — 1) max{n(i + 1), n{i)} 
ie.j 

< — j ^(c(<T(j + l))n{i + 1) — c{a{i))n{i)) J + {r — p + q — 1) max n{i) 

\'i.eJ / 

< I y^{c{a{i + l))n{i + 1) - c{a{i))n{i)) ] + (r - p + g - 1) max n{i). 

\ ^ — ^ / l<i<k 
\i(J / 

Therefore we obtain 

E (n(^^(^?)c(.)c(.+i) 



Recalhng the function g and the definition of fl„i in Subsection 15.11 and using 
we conclude that (|7.8p is bounded by 



By Lemma [3.31 "we may take 5 so that Q*''^{T,g) < p. Since the constant C{g) 
above does not depend on the choice of mo, we obtain (j7.7p by taking large rriQ. 
We finished the proof of Theorem 11.51 



Appendix A. Eigenvalues and eigenvectors for different Banach spaces 

In Theorem II. 1) we may choose a variety of p and q. Besides, as we will see 
in the proof, the space CP''^{T, V) depends on many objects, such as the system of 
local charts. Moreover, in [7] and |15) . other Banach spaces of distribution were 
introduced, for which the analogue of Theorem 11.11 holds with different bounds on 
the essential spectral radius. So one may ask to what extent the eigenvalues of the 
Ruelle transfer operator on different Banach spaces coincide. Theorem 11.51 gives 
one answer to this question because the dynamical Fredholm determinant does not 
depend on the choice of Banach spaces. The following simple abstract lemma, which 
may not be new, gives a more direct answer. 

Lemma A.l. Let B be a separated topological linear space and let || ■ ||i) 
and (i?2, II ■ II 2) be Banach spaces that are continuously embedded in B. Suppose 
further that there is a subspace Bq C Bi Ci B2 that is dense both in the Banach 
spaces (Bi, || • ||i) and {B2, II ' lb)- Let L : B B be a continuous linear map, which 
preserves the subspaces Bq, Bi and i?2. Suppose that the restriction of L to Bi and 
B2 are bounded operators whose essential spectral radii are both strictly smaller 
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than some number p > 0. Then the eigenvalues of L : Bi ^ Bi and L : B2 B2 
in {z C \ \z\ > p} coincide. Further the corresponding generalized eigenspaces 
coincide and are contained in the intersection Bi fl i?2 ■ 

Proof. First, we show that the essential spectral radius r^ssii^) of an operator 
C : B ^ B o\\ a. Banach space B can be expressed as 

inf{ r{C\w) \ W G B \s a, closed ^-invariant subspace of finite codimension.} , 

where r{C\w) is the spectral radius of the restriction of C to W . Indeed, take any 
p > ress(£), and let W be the image of the spectral projector corresponding to the 
part of spectrum in the disk {\z\ < p}, then we see that the infimum above is not 
greater than p and hence not greater than ress{^)- Next let W be an arbitrary 
closed /^-invariant subspace of finite codimension, and let W be a complementary 
subspace of in ;B of finite dimension. Let tt : B W and tt' : B ^ W be 
the projections corresponding to the decomposition B = W ® W. Then we can 
decompose £as£ = £o7r + £o7r', where Cot:' is of finite rank. This implies that 
the essential spectral radius of C is bounded by r(£ o tt) = 7'(£|vf) and hence by 
the infimum above. 

The intersection _Bini?2 is a Banach space with respect to the norm |M|i + ||-||2- 
From the definition above, we can see that the essential spectral radius of the 
restriction L ; _Bi n ^2 ^ Si n i?2 is bounded by the maximum of those of L : Bi — > 
Bi and L : B2 ^ B2- Thus, to prove the lemma, we may and do assume Bi C B2 
and II • II2 < II • 111. 

Consider p > as in the statement of the lemma. Let £^ C i?i be the finite 
dimensional subspace that is the sum of generalized eigenspaces oi L : Bi ^ Bi 
for eigenvalues in {z G C | |z| > p}. Replacing Bi and B2 by their factor space by 
E respectively, we may and do assume that E — {0} or that the spectral radius of 
L : Bi ^ Bi is strictly smaller than p. 

We can now complete the proof by showing that L : B2 —>^ B2 has no eigenvalues 
greater than or equal to p in absolute value. Suppose that it were not true. Then 
we could take an eigenvector for L : B2 ^ B2 corresponding to an eigenvalue A 
so that |A| is equal to the spectral radius oi L : B2 ^ B2 and is not less than p. 
Since Bq is dense in B2, this would imply that there exists a vector v G Bq C Bi 
such that ||L"v||i > \\L"v\\2 > |A|" for aU n > 0. This contradicts the fact that the 
spectral radius of i : _Bi — > i?i is strictly smaller than p. □ 



Since the spaces of functions in this paper and , as well as those in |15j , are 
completions of the space of C"""^ functions and embedded in the space of distribu- 
tions, the lemma above tells that the part of spectrum of C outside of the essential 
spectral radius does not depend on those choices of Banach spaces. 

In view of Lemma [A. 11 it is natural to ask whether there exists a Banach space 
containing C^~^{V) on which C is bounded and has essential spectral radius strictly 
smaller than Qr-i{T, g). We expect that there may be such Banach spaces if d > 3 
but not if d = 2. (For hyperbolic endomorphisms, we can find examples of such 
Banach spaces in [H Thereom 3].) 
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Appendix B. Proof of the inequality ()1.3p 

We show here the claim in Remark O that pP'«(T,g) < miti.[i,^] RP '^-*{T,g). 
The proof will imply that the inequality can be strict. Put 

i?'''«'*(r,g,m) = sup|deti:'T'"|-i/*(x)|5('")(a;)|A(P'«''")(a;) 

X 

for m > 1 and t G [1, oo]. Since supp(5) is contained in we have 
(B.l) RP^'i^\T,g)^ lim (i?P'«'*(r, g, m))^^". 

m — >oo 

For each m > 0, we put = H^LV^^'^C^)' ^+ = ^ I det DT" (x) | > 1} 
and y™ = - V^'. Then we have 

j (I^Mj . \'^P-i-"^)){x)dx < [ (l^^™)] • A(f'«'™))(a;)dx 

+ / (IdetLT™!"! • |5(™)|A('''«'™))(r~™(2/))dy. 

Since | det L>r™|^i/* > 1 on and | det L>r™|-i/* > |detL>T'"|-i on and 
since K!" C V and r™(V:[") C T(V), we obtain 

f (|g(")| . A(P^'?^"'))(a;)dx < C-i?P'«'*(r,g,m) 
Jx 

for any m > 1 and t £ [1, cx)]. Now the claim follows from (jB.ip and the definition 
ofpP'«(r,g). 

Appendix C. The key estimate ()4.24p for integer r 

For the convenience of the reader, we reproduce here the proof of (|4.24|) from 
[3, when r > 2 is an integer. 

By "integration by parts on w" , we will mean application, for / G C^(M'') and 
g e CoHR''), with Ei=i(5j/)^ 7^ on supp(g), of the formul£0 

Rewrite the operator S'^^'J^ as S^]^{u){x) — V^''^{x, y)\ det DT\u{T{y)) dy, where 
(C.l) 

The required estimate thus follows if we show, for some C(T, G) > 0, that 

(C.2) |Kf;;(x, y)\ < C{T, G)2-(''^i)'"^'^^"'^> • 2'''"'"{"^^>6(2'"'"{"^^>(a; - y)) 

for all {i,T),{n,a) £ F with (^,t) (n, cr). Recall the constant C(T) in (HT^ . 
W may and do assume max{n,£} > C{T) in proving (jC.2p . Integrating (jC.ip by 
parts (r — 1) times on w, we obtain 

^^To handle noninteger r > 1, we may use "regularised integration by parts" instead. See 
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where 77, w) is C°° in the variables ^ and 77, continuous in w and supported on 
M'' X E'* X supp(G'). Using (|4.18p . we can see that, if V'e',n,o-(0V'e/,T(7y) ^ 0, then, 
for each muhi-indices a, (3 and for ^, 77 S R'', 

(C.3) ||5|'9^F(e,77,-)llco < Ca./3(r,G)2-"l"l-^l''l"('^-i)'°""{"'^>. 

Put Hn,e{^,r],w) = 77, w)V'e',n,o-(OV'e,£,T(77), and consider the scaHng 

i?„,,(e,77,7«) =iJ„,,(2"C,2\zi;). 
The estimate (jC.3[) imphes that for aU a and /3 

Denote by F^^^""^ the inverse Fourier transform with respect to the variables ^ and 77. 
Then the estimate above on Hn,e implies 

\{¥-^'H„,,){x,y,w)\ = \{¥^^'Hn,e){2"x,2'y,w)\ 

< C^A'^, G) •2-('^-i^'"-'^^"'^> ■6„(x) •&,(7/) 

where 6„i is the function defined in (|4.2ip . Therefore we obtain 

\V,yix,y)\ = f {¥^^H^,t){x - w,T{w) - T{y),w)dw 

J supp(G) 

< G(T, G) • 2-('-i)"-'^^"'^> . / bnix - w) ■ h{w ~ y)dw , 



where we used the fact that T is bilipschitz to replace T(7i;) — T{y) hy w — y. Now 
(1021) follows from ([422)) . 
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